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PREFACE 



Th$ findings of program effectiveness reported in th^s. 
evaluation are sharply at .variance with those in the recent 

' AIR report on the impact of Title VII bilingual programs. 
For that reason, this paper, which was presented to the 
Southwest Educational' Research Association meetings in 
Houston, February 1979, is_ included as a preface to -the 

v annual evaluation report. 
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DOES BILINGUAL EDUCATION WORK? 

/ 



Those "present at th^ creation" when the bilingual educa- 
tion program was established by Congress in 1968 would probably 
•have responded: "We don't know, but it is certainly worth a 
try." The "negative caseTfor bilingual^ education was demon- 
strated, in the statisticsf-feiat showed from 50% to 100% of 
languagp minorities dropped <$ut of school prior iq the '12th * 
grade i'n a school system using only English as -the medium of> 
instruction. t , % f 

J6se Cardenas, "an early supporter of bilingual programs, 
described bilingual education hs an "untested alternative," * 
noting:. , 

Perhaps Hispanic minorities are so' overwhelmingly in„ 
favor of bilingual education regardless of lack of 
evidence of its success because the experiences with 
past programs have been so negative . . . If . . 1 
the drop-out rati:, of Mexican American .children in a'r 
South Texas school system is 90 percent, the parents 
•cannot be blamed for strongly recomihending an untested 
alternative. 1 

/ • . •' , • • - • r 

The 1970's, however, have become the "age of accountability " 

in/ education, an<J pressure has mounted on both federal officials 

and. local programs to. "come up with the answers" on the value m 

ojt bili.ngual education. ' ^ * 

fwo types of efforts have been mounted by the U. S. Office 

jot Education in this search for answers. One has been directed 

^toward individual programs. .Evaluation data from such programs 

have been screened by the Joint Dissemination Review Panel (JDRP) 

of OSOE .which attempts to determine., that the results are valid and 
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reliable, as well as educationally -significant. Such programs 
are "validated" and special attention given to the <3ata they 
have" produced. Individualized Bilingual instruction (USE), the- 
program reported in this document , is one bilingual program 
validated by JDftP. v 

The other type of evaluative, effort has been dlir.ejrteci 
toward classes of .programs. „ These are nationwide "impact 
studies" examining a sampling of procjcaiftS from 4 cowroon fanning 
source to determine if, collectively, they are more effective 
thsxi diverse "other" educational approaches in meebir^ the needs 
of the target population . | F<Pr'*bilinguaL education the national 
"impact study" w&s completed by American Institute for Research 
(AIR) with its final report issued in 1978. 

The answer to the question: "Does Bilingual Education 
Work?" that' emerges from the IB I data, and ,f rom the AIR Tmpact 
Study, is in sharp contrast. as summarized below: 



, CONCLUSIONS >FROM" AIR AUD FROM"lBI DATA ON 
EFFECTIVENESS OF BILINGUAL EDUCATION 



AIR 

ENGLISH LANGUAGE ARTS 

« 

"In general, across grades < 
when total Title VII and 
nonrTitle VII .comparisons 
were made, the Title VII 
students w,ere performing 
in English wors,e than 
the non-Title VII stu- 
dents • n3 *" 



"Relative to national norms > 
Title VII Hispanic studefits, 
across grades, were perform- 
ing at about the 20th percen- 
tile in English reading, "3 

MATHEMATICS 

"In Mathematics, across 
grades, (Title * VII children) 
were performing at about 
the same level as non- 
Title VII students-" 3 



"Relative to national norms, 
Title *VII students were 
performing at about the 
30th percentile in mathe- 
matics*" 3 * * > 



' IBI 

' ENGLISH LANGUAGE ARTS 

On a vocabulary test in- English, 
when Title VII -children -were • 
compared to the .comparison gro^p 
j of the same age and language 
'dominance, Titlfe VII children 
scored significantly higher at 
every age level* 

On a test of English Reading*, 
when Title VII* children were 
compared to the comparison group 
' of the ( same age 'and language 
dominance, Title VII children 
scored significantly ^higher at 
every age levei. 

Relative to national norms, 
Title VII Spanish dominant stu- 
dents were performing between 
the 37th and 47th percentile in 
English reading. 

MATHEMATICS 

On a te^t of mathematics skills, 
when Title VII children were 
compared to the comparison group 
of the same age, children scored 
significantly higher at every 
age level. 

Relative to national norms, 
'Title VII stuaents were perform- 
ing between the 42nd and 68th 
percentile in" mathematics. 



The IBI program, was not one of the Title VII programs 
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included fn the AIR study.. It .might be -concluded, therefore, 
that "IBI somehow represents one successful program in a generally 
unsuccessful educational effort. The author feels, however, 
that the real issues . involved are: (1)' what are the fundamental 

requirements for* evaluation of effect in a bilingual program, and 

* » 

(2) are the conclusions of the two mentioned evaluations equally 
credible? k 1 

The U.S. Office Education sets as its standard that 
the program must (1) be able to sjiow reliable evidence of program 
effect, and (2) provide Credible' estimates of Sow the children 

, e 4 " 

* would have performed without the program* To meet this later 
, requirement, the AIR impact study used a comparison group model. 
Their original evaluation design called for school districts* 
included in the study to nominate other classrooms in their dis- 
trict, or nearby districts, that would have children the same 

as those in the bilingual classrooms in all important variables. 

» • 

Their statement of this research design was as follows : *t 

Comparison classrooms nominated by each site were to c 
contain students who would qualify for bilingual educa- 
tion and who were essentially the same ethnic background, 
linguistic competence [emphasis mpLne] , and socioeconomic 
&feat\*s'as the students in Title v£l project schools. 7 

The progress of these children over the year would p^o- 

vide the' estimate of how children in the bilingual classrooms 

would have been expected to perform without the program, (Minor 

. differences in pretest scores to b£ adjusted for statistically 

by analysis of covariance.) 



• The AIR Study ran into problems with this evaluation ■ 
design almost immediately. Out of the thirty-eight school dis- 
tricts included in the study, eighteen_indicated they could no.t 
identify any comparison classrooms that met the criteria. The 
twenty remaining districts, howev r er, did nominate classrooms that 
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were used for the comparison group. 

Teachers were - .asked to classify children as to their 
language dominance. , At this point it became evident that the - 
comparison classrooms .had students of the same ethnic background' 
as those in bilingual classrooms, but almost all of the students - 
spoke only English (83%, or 1,349, t>ut' of the total sample in the 

» ^ 

Hispanic comparison group of 1,622 children), 

j 

Tables arfe provided of 'the classification by language 
dominance of Hispanic children who were present" both fall 1975 
and spring 1976 when the impact study testing was carried put. 
■Based on teacher classification, 74% of the children in the 
bilingual classrooms were either non-English speaking or bilingual, 
compared to 17% in the comparison classrooms as seen in the 
following table: , 

Classification by Language \Dominance of tfispanic 
Children Present Fall and Spring 19765 



Monolingual English 

English Dominant 
Bilingual 

Spanish Dominant 
Bilingual 

Spanish Monolingual 



Title VII Classrooms n Non-Title VII 
■ , Comparison Group 



N=l 


,055 


26% . 


N-l 


,349 


83% 


N=l 


,908 


47% 


N= 


188 


12% 

* 


N= 


273 


7_%_. 


. N= 


8 


* (less 










> 


than -1%)' 


N= 


860 


21% 


N= 


77' 


5% - 
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This would -seem to present a., serious dilemma, e.g., how 

A * 

to examine the effectiveness of an educational program for chil- 
dren who are' bilingual or non-English speaking, when only the „ 
treatment group contains a significant number of bilingual q^p 
non-English speaking children. 

The solution jised l n the AIR Impact Study was to change 
the e valuation de£i|f , eliminating* the requirement that the two 
groups be compared on the basis of similar language competence. 
The final report* issued in March 1978 is careful to leave 
language competence out of its descriptions of the variables on 
which a match was found: 

For each Title-VII classroom selected for testing, district 
project personnel were asked to nominate son-Title VII 4 
classrooms* (comparable students) within their own or within 
a nearby district whose students matched the Title VII 
student in terms of (a) 'ethnicity, (b) socioeconomic status, 
, and (c) grade level [emphasis mine] . 6 

Because the subsample of children^ who could be tested in 

Spanish was so small (under 5%) in the comparison classrooms, 

some tables of results in Spanish reading were included* but no 

comparative analysis was attempted. The AIR report stated^ 

It should be noted that the Impact Study's original analy- . 
sis plahs had specif ied" the stratification of comparative 
analyses by judged language dominance group (i.e.', separate 
1 analyses 5 for groups oIe students, who completed similar com- 

binations of test and questionnaire instruments) . However, 
this approach was not feasible in* view oA the small number - 
of students in the non-Title -VII comparison classrooms who 
^/ere given test questionnaire^ developed for Spanish mono- 
lingual students or for Spanish dominant bilingual students. 

<* 19. 

O 
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Spanish dominant children were given tests below . 
their -actUAl. grade level for English reading, using ' 
expanded scale scores, data were then pooled across all language 
dominance groups for the tests of program effect. This meant 
that the "credible estimate of how children wduld have performed 
without' the* bilingual program" was based on the gains made in ' 
"other" clkssroqms by children who were overwhelmingly English, 
monolingual (85% in each of" grades 2, 3,,and 4K With thift evi- 
- dence the AIR impact. Study reports what they consider to be a 
"puzzling finding": 

in English Language Arts, 'participation in an ESEA 
' ^itle VII Spanish/English,bilingu^l education project 
. did not appearNto produce" 'gains in student achievement '< 
, over and aboye what Would 'be expected had the 'students r 
been assigned to a traditional classroom. * In fact, i n ' ^ 
. ' several' grades, the .non-Title VII students- made slightly 

• greater gains in English Language Arts. (A partial . ■ 

\ explanation of this puzzling finding may be substantially ' : 
greater- amount' pf . time devoted to Spanish Language ~Arts 
.instruction in the Title VII classrooms .) 8 

The IBJ- data axe based on an evaluation design in which 
the evidence for.hdw project students would have performed 4 
witho'ut the bilingual project is based on the accumulation of 
aftttual pretests of students who enrolled in the project at differ- 
ent agjs, built, up over a period of yea'rs. in this process a 
child who entered the, program . at age four wo.uld have a pretest 
which went int9 the "project norm group" data bank for four-year- 
olds. ' Subsequently/ at age-five this child' s posttests would be 
compared to the project norm' group for five-year-olds (made-up 



from pretests of b£her children who entered the program at 

.age five). Because the project enrolls more new ^children at 

* , r „• * 

the younger ages the norm group at the #ppef age levels had 

to be expanded through some -testing in a'neighboring school 
district. The children in this testing met exactly the enroll- 
ment criteria used to enroll project children. ♦ * 

.This type of comparison group ^provides' ari automatic match 
pn such factors a> eohipicity and socioeconomic level. Age, " - 
rather, than grade level, is used as the basis for comparative 
analysis to overcome, the problem of out-of-grade level placement 
which a*e very common for bilingual children. J\> 

The match on language' competence betwee'n project posttest 
group Snd project norm 9 roup is accomplished by having all tests 
given in pairs — achievement "tests and a language test together. 
The comparisons are then made separately by 'language dominance 
for curricular areas. in which language 'dominance made a signifi- 
cant difference (reading and vocabulary in Spanish-ana English). 
It^was found that for mathematics and handwriting, language 
dominance did not make a .significant different! so the ;tests are 
ppoled. * * ' 

. Attendance is kept individually in the IBI. program and 
children are given posttests after- each 100 day's attendance 
in the program. This means that children are being tested' 
throughout the year. * When an evaluation is aone the tests 
are grouped by age and attendance period and^rimary language 
classification. Analysis is done to see if .the superiority 
after differing periods of attendance is statistically signi- 
ficant when compared to the project norm group of the /Same 



age, and the same lang-Uage classification. The writer suggests 
that in answer tb the question: "What are the fundamental* 
requirements for evaluation of effect in a bilingual program?" 
that it would be reasonable to include the expectation that 
whatever comparisons are drawn be based on groups matched by 
-'language dominance. 

* 

s' The IBI data and the AIR data ■ are on a- totally ■ different 
scale in tQrms of numbers of children tested and mass of data 
handled • tilR reports that ft In all,, over 11,500 students in 
' 38,4 classrooms, in 150 schools at 38 different sites across the 
United States were initially included in the Impact Study Sample." 
The IBI— data are based on one program with three different sites. 
However, when numbers of children who are Spanish domiriant are 
separately considered, the AIR study is. based on 1,133 Spanish 
dominanfc-ehildren in the treatment group and 85 in the comparison 
group-; the IBI data are based on over 600 tests of Spanish 
dominant children in the treatment group and over 800 in the 
project norm (comparison) group. In terms of providing infor- tI 
mation on children dominant in "another language, the category of 

9 

children who were the prime concern of Congress when it estab- 
lished the bilingual "education program, there is m\ich less 
difference in 'the scope of the two .-studies . 

It is hoped that the concern for "answers" to the question 
of the effectiveness of bilingual education will begin to 
produce more programs with definitive data. The lack of such 
evaluation seems J^this writer to be more related to the prob- 
lems of how to find suitable tests/ norm groups, and comparison 
groups for linguistic and ethnic minorities than it does to lack 



of concern lor evaluation. Some aspects* of the evaluation design 
* used by IBI may be helpful to other programs. The danger in 
the current mood of "panic" for evidence of effectiveness is that 
evaluations based on "not quite good enough" comparison gfQups, 



or "pKbably irrelevant" norms from tests standardized with 
English speaking children will produce a rash of conclusions 

that will distort ratlrer than qlarify the answer to the question 

* \ 
Does Bilingual Education Work? 
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'INTRODUCTION * 

Individualized Bilirigual instruction, or IBI,* is a 
bilingual early education program for' children preschool through 
third grade. The children' served are -from families of migrants 
or seasonal farm workers. - The two languages of instruction are 
Spanish and English. ' • ' 

The*fcrogram was started in 1971 under Intermediate School 
District 104 of Ephrata^ Washington (an educational agency that 
•has since been legally dissolved) ; ?t currently operates under 
Sunnyside School District 201 (Washington state) .« 

The name of the program was changed in 1978 at the sugges- 
tion of staff of the USOE working with the national -diffusion net- 
work. The former project title was TRAINING MIGRANT PARAPROFESSIONALS 
IN THE B-ILINGUAL MINI HEAD START.* USOE is trying to" disseminate • • 
programs which they feel- have been successful to other school 
districts serving similar populations. 'They felt that another' 
title .would be more descriptive to potential- users . Dropping .the 
"Head Start" from the title clarifies that the program is serving 
children both preschool -and school-age up through grade three. . 
Dropping "migrant" from the 'title clarifies that the program is 
•usable with any bilingual population even' through it was developed 
with migrants. The new program name selected, INDIVIDUALIZED 'V 
,|*ILIN(3UAL INSTRUCTION;,;^ .IBI ,. stresses, the essential elements of 
the program; a sequential bilingual program for children preschool ' , 
through third grade. ..-'.* - " ' 

. ^ Because IBI is an interstate program it has ah administrative 
office in both Washington and in Texas; £wo operating sites in 
Washington State' and one site in Texas. > The Texas site operates 
a mobile component in which the Texas staff (administrative and 
training staff, as well as teachers) relocate' to northern work 
sites prfeyi^ing .continuing services to 'children\who' move- from ' 
Texas in the migrant stream. * 

• This evaluation represents, the thirteenth in a series 
(the first published, under this project name) that have, been prepared 
for the Division of Bilingual Education in the Office of Education. 
♦Funded under the previous project name 'of "TRAINING MIGRANT 
PARAPROFESSIONALS IN THE BILINGUAL MINI HEAD START." 



(All previous evaluations are available in libraries through 
the ERIC system- A list of ERIC reference numbers is giv^n oo 
page 74.) , 

. k The primary funding for this program is from the OSOE 
Division .of Bilingual Education, Title VII of ESf^A.i 

. This program is a nationally validated bilingual program 
by / the Joint Dissemination Review* Panel of the U. S. Office 
of Education. 

The program is also a ^Developer/Disseminator program in 
the National Diffusion Network. 

* * * 

Final Evaluation of the 19 77-78 Program Year 

* *" 

I 

p s Number 13 in a Series 

Published January, 19 79 
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PROGRAM DESCRIPJION 



Originated as an R and D Effort 

In 1971 all federal agencies were asked to make "Migrants " 
a priority for services. .The Office* of Bilingual Education sent^ 
out a request for proposals. (RFP) to educational agencies reques- 
ting a program effort uniquely' designed to meet the needs of this 
service^roup. This proposal >was submitted in response to this 
RFP through Intermediate , School District 104^ of Ephj^ata^ Washing- 
ton (a district providing services to schools whiclvlhas s'inae 
been legally dissolved) . Its blsic concept was that a key 
problem in educating migrant children is the fragmentation of 
responsibility for providing educational services caused by the 
child's frequent 'moves. The model proposed was therefore an 
administrative model that was interdistrict in its operation in 
Washington State, and interstate between Texas and Washington 
st v ate (also other states to which children moved) . _ " - 



Administration * * 

The program has its administrative office in Pasco, Washington, 
with a second administrative office in firulla, Texas (the home bas£ 
site for the Texas ^program, and origin of children served in the < 
mobile component which follow children when they move). The.-. ^ 
funding agency for the program has changed four times in its 
seven year of program operation, but the ; £>asic administration and 
operation of the program has been the same throughout. At present 
Want^funds go through t Sunny side School District 201 in Washington 
state — the program' operates elsewhere as described subsequently. 

Operating Sites \ 



A year-round program is operated at Connell and at .Moses Lake 



Washington, and in La Grulla,' Texas. The Washington sites are 
iYi 1 the "Columbia Basin Area" which was reclaimed from desert by 
the\ Columbians in irrigation project and is§now Very fertile 
irfling country. Almost "all .the settlement in the area is new,. 



^ related* to forming mafde possible by s irrigation/ A sizeabJe 
proportion of the population w ih the two towns arc Spanish* 
speaking families who came \n to work the crops. Mafly ^hAye 
settled out in the a'rea. Mftny others come xn on a aensoneJ 
basifs. . ' ; \ 3 c 

La Grulla, home base for the Texas program, is a small town 
almost on the Rio Grande River in the tip oi South Texas. La 
Grulla takes its name from a migrating bird, now extinct. Like 

.the bird, the population of La Grulla almost all migrates' ever/ 
,year to do migrant farm work,. The employment statistics during 
tne winter a few years ago were 5% (e.g., 95% unemployed during 
the* winter home base /period, except for occasional work lasting 
a few days) . NearLy all of the Income of the families in town 
therefore comes from the annual migration to the north. All of 
the families are Spanish, speaking , and Spanish is reinforced by . 

•the availability of TV channels received from Mexico. 

The mobile component -has involved teachers moving north and 
continuing to provide services to children in temporary work 
locations. Most of the" northgrn^sites are in Washington state; . 

-but mobile component teachers have also gone to. Illinois, ldaho7~ 
and Oregon. 

T ypes' of Children Served 

About 98% -of the children served in the IBI program are 
Mexican or Mexican American jone or both" parents) . A Very tugf) 
proportion are monolingual Spanish speakers (46% 4>t those >^ 
enrolled through April > 19 78- when the statistics were collected). ' 
This proportion is undoubtedly higher than the proportion of.' 
monolingual Spanish speakers in other "bilingual programs, in part 
because thisyjjprogram starts at' the preschool level (age three), 
"before the children have -had much Contact with language outside 
'that- in their Spanish speaking "home . , An additional 26% are 
'listed as Spanish dominant .bilingual although this can mean a 
very very minimal .understanding of English. \t is operationally 
defined as. a score higher in. Spanish than in English- on an auditor 
vocabulary test, with the score in English anywhere past the" 

• •• •• . . ' : • » 
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point where it could be attributed simply to cussing. 

• The o-ther - *-j of th6 chUdce™ ac« us-ted. as pcnoary 
languag^e "English." Of these 9% are considered English dominant 
bilingual", which jneans they score best in English on a vocabulary 
test but have a score' above the guessing level in Spanish. 18% 
are .monolingual in English. As in most bilingual programs both of 
these groups of children also are likely to be deficient in 
English language skills— most often coming from a family that 
is -or .was Spanish speaking but attempts to use English' with the 
children to help them succeed in' a predominantly English speaking 
community. The children in these categories are almost entirely 
enrolled in the northern sites. 

The children are from families* in seasonal or migratory farm 
labor which pla"ces them near the bottom of the socioeconomic 
scale^. The age range served is basically three through eight. 
The program continues to "work with children through the third 
grade.. , • . 

Staffing \ * . • 

Because of the basic concept of this program— to provide con- 
tinuity to children who moved aboutJ--'the teaching staff for the 
program is entirely adults from the -target population (more than 
half -are parents' of children served). 

Efforts* to try programs- that moved in the stream with migrant 
children had' been made before this program was started. These 
tried to staff with certified personnel, and this was almost . ' • 
entirely unsuccessful. There is/a shortage of such personnel }' 

t The job conditions in such a mobile program are unattractive— £ ew 
peoplewant to irfove several times a year, living in temporary 
housing in remote rural areas if there is an Alternative. With 

» '^bonus pay" some are willing to do it. Some with a "peace corps", 
set of values are interested- in doing it.. However', even these *..» ■ 
dedicated te^ehers are hard to use because of tfcfc problem of 

* housing in the; northern areas . Almos£ all available housing is 
reserved for the- farm workers. By .utilizing -other adults from 
families who were already housed, because some of the -family 
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work in the fields, this was not a problem. 

The adults in the migrant families also sacrificed in order 
to teach in this program since , for the limited period of time 
it is available, farm work pays better than the teaching 
salaries they received-/ But the teaching position offered year- 
round pay which offset the loss of the higher income they could 
have made with easonal work. The teaching adults recruited 

brought a .special understanding and committment to the job from 
.first-hand knowledge of the difficulty of obtaining an education 
for a child moving in the migrant stream. * 

It was for this reason that one fundamental premise of the 
program was that it myst work using previously untrained and 
inexperienced bilingual adults recruited from the target population 
Certified staff are hired by IBI, but in the IBI program they work 
as supervisors and trainers — backup^staff for the para^rof essional 
teachers, - and do not work directly with childWa_Jinless filling 
in as a substitute. ~ , 

The problem of having._ia_Jilove staff obviously did not apply 
to the operation of the year-round sijtes. However, it was 
decided to have one basic program model and to use adult^.from 
the target p9pulation as teaching staff., in thes^e afeas as wel>.* 
Since there was a real shortage J of available bilingual Certified 
people in all three sites, this decision me^Sexisting circum- 
stances. The few that could be hired were stretched by virtue of - 
having them oversee a number of paraprof essional teachers and 
under them quite & feW more bilingual children than could have 
been'taugrit directly by the bilingual certif ied#t^achers . 

This decision accounts for the /cumbersome title by which 
the project originally went: "Trailing Migrant Paraprofessionals 
in the Bilingual Mini Head Start." )& great deal of the develop- 
ment effort went into selection of curriculum materials that 
could be effectively used by paraprofessional staff, as. well as. 
field testing training methods to see what methods worked best 
to quickly produce competent teaching in previously untrained staff 

It should be noted that IBI is now disseminating its curri- 
culum and methods to other sites. 'Nearly all of these sites have 
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the usual combination of 'certified teachers alid aides', and the- 

certified staff have been very impressed with" the training as 

valuable to them. It was designed to be very thorough and 

specific because this was necessary for inexperienced people. 

It alsa-seems to have produced training that is well accepted 

by and easily utilized by professional teachers, howeve£. 

i 

Curriculum ' ■ ' 

All curriculum materials used by IBI can be individualized 
s or taught in small groups. Each has the sequendinq^/Built in 
so that the 'teacher does not need to h<jve the knowledge on how 
to, -develop concepts from simple to more compleif. Most of the 
v ^ materials- are carefully programmed, so thajs^even review* is built 
in meaning 'that children retainwlwtr^ney have learned and add 
to it. , The IBI model attenjp€s to provide continuity v not.. only\ 
in a geographic sense^^Jut f rom year to £ear, and preschool -to 
- school. Each academic area has a continuous track curriculum from 

• preschool ^ through third grade. IBI has developed mastery tests 
keyed to the curriculum materials used, which help in placement • 
of the child, and also help in planning remediation if the 

* . child forgets something during a move. 

Most of the curriculum materials are relatively self 
contained, using a teacher presentation book or child workbooks, 
or consumable worksheets such as in handwriting. IBI avoided 
materials which had to have a lot of teacher preparation, because 
many IBI teachers handle two or three groups, a day, each vfor a 
limited release time period, and cannot spend extensive time in 
preparation. The u§e,of one set of materials for teaching of 
reading, or of math, goes contrary to current trends with are to 
use management systems and to index a wide variety of^curriculum 
' resources. A program that moved , obviously could riot carry a 
"resource room" with it. However, even in the year-round sites,' 
it was decided to Limit the curriculum materials to one series m 
because it was found that the most effective teacher training was 

* that which was most specific to -the curriculum used- — that 

' limiting the curriculum to a manageable s£t 'meant teachers could 

be trained to use it effectively in a relatively short time. 

ERIC . . ■ . 24 



All teachers, are bilingual. They use both .languages in 

teaching "depending on what the child seems to understand.- 

» m 
Children of mixed language capacity will be assigned in the 

same group; so the' children who do not use much English will 

hear it used with, other chtlUren^ewn if the teacher uses, 

Spanish mo^t-of tl^e time in communicating with that child\ . It 

has v not been .found practical or useful in the IBI program to 

strive for any particular "percentage" of ufee of one language 

« or the other. It has not been the policy to establish any- 
period in^wlxich use of the other language is "restricted" to 

'force children to learn the language of "choice. The results of 
this policy and? practice seem to be validated by the gains 
the children make in both language and academic subjects. 

y 

Classroom Organization 

The preschool centers operated at the year-round sites 
have academic work areas where children work at small tables 
with the teacher moving arotind them, or where the- children sit 
around the teacher for a lesson involving a teacher presentation 
book. The rest of th£ space is divided between open area for*" • 
JLarger group activities and interest* centers , common to most 
pres ; chools.^~ Thfe^^hool -ag£_£^grM^sea^ similar work areas, 
and have a corner or bookshelf to keep activities -and materials 
to be used during independent choice periods. 

• The daily schedule has academic periods in which the teache 
organizes and manages the learning time. It also has child 
choice periods *in which the child selects and organizes use 
of his time. The* choice periods are used as a reinforcer for 
the shaping of academic behavior — access to the materials and 
activities is contingent upon completion of %; " contracts'" for 
the academic materials, or in token exchange for tokens Wrnfed 
duritig the academic period in some subjects. In disseminating 
the program IBI has taken tile position" that use of a tokens or 
contracting system is optional -to the adopting district, but 
that use of the positive reinforcement teaching methods is 
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essential, whether or not it is backed up by time management 
or tangible* reinforcSrs . IBI has appropriate training instru- 
ments for a-ny of^^th^se options, and all have been field tested 
* at IBI sites-. . < * 

Digseminatioft Services and Costs < . 

3 The IBI curriculuflv' and training materials are available 

for adoption by other districts. 1 ' (Tibs far there has been no 

interest, in. the adoption of the interstate 4elivery systfem.) 

The curriculum areas can be adopted as single components.- 

The requirements of an adopting' district a^re that they have 

the" staff capacity to teach children in small groups under 

teachers or aides^\|id that they purchase necessary curriculum 

materials, provide time for training. of staff by IHI, plus 

assigning some person responsibility for on-site continuing 

in-serVice, and that they be willing to evaluate their results 

in some way to be mutually, worked out by the adopter and IBI: 

% IBI makes m available at cost citfrici^p materials it has developed, 

training instruments (which can be locally *reprodxic&d) > initial 

* * ' * *■ £v , 

staff training (dnly cost to adopting district isftravel and per 

J r - -*t % 

diem tor visiting trainers)*, and follow-up vis^^ as. requested 



during the startup phase. In areas where IBI has^/^large number 
of adoptions and potential adoptions (California) the Gosts are, 
minimized by having IBI travel costs to th^, state shared by more 
than one district. • * ~* M 

^ 3=£-the local district cannot manage the costs, most are 
eligible for 'fitle^IVC grarrvfes available to districts choosing 
.to adopt validated programs,, and managed "by irhe-state office of 
education-. . ' < — — 

Program Effectiveness 

Information on ef f ectiyeness • of the. IBI program in each of * 
its components is detailed in th^ ajjinuc*l evaluation. Quickly* 
summarized, the children have greatly increased their achievement 
in language, math, reading, and knowledge of cultural concepts 
at^HSlI -ages, arid the^preschodl v children hafve made significant , 
gains in academic readiness Skills and handwr itinq . The'se 

• . • . • •• J 

OR 



results have been verified by outside evaluation specialists 
They have been accepted as providing "credible evidence" of ■ 
an effective educational program by the Joint Dissemination' 
Review' Panel of USOE. 
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INSTRUCTIONAL COMPONENT ■ • 

COM, i. CHILDREN THREE TO FIVE WILL LBARN PRESC'HO,OC fiOflCEPTS. 

■ 4 

THE NEED': IBI children who are three,- four, or five are tested » 

using the Cooperative. Preschool Inventory . \ This is a 

nationally standardized test originally developed to measure 
* » 

t the outcome of Head Start programs. It is published in* 
Spanish an4 English, §nd project cfhildren are tested in their 
primary language, it measures, concepts, .usually considered 
important as school xtfadiness skills: the ability 'to under- 
stand and' follow directions, size and number concepts , the' 
reoognition k,w 5t H nro*b^ and shapes, etc. ' » ^ 

The project has compiled pretest scores of children who . 
havje entered the program at different ages over the past seye» 
years. These scores represent the level of skills projects T 
children would -have demonstrated without benefit of the pro- 
9 r * m - *£ s shown in Figure 1 which follows, without the program 
three-year-old children had an average score at the 30th per- • 
centile — i.e., out of a national sample 30 percent of children 
had scores this, low or lower. Four-year-old children had 
average scores at the 35th percentile. Five-year-old children 
served by the project ^veraged scores at "the 43£d percentile. 
In summary the target ' population for t'his program start out - 
with preschool concept or school readiness skills in the lower 
half —almost the lowest third, compared to children tested in 
the n^rtional sample; 

\ « 

THE IBI CURRICULUM: IBI combines concept and language learning ~ 
, using, the DISTAR Language curriculum published in English by 
SRA, and published in Spanish by Bilingual ^ini Schools (a non- 
profit corporation which developed the Spanish^ translation for 
• the IBI program, and is. now licensed by SRA' to sell the Spanish 
edition to any schools that would like to use it) . 

This curriculum is taught to a small group of children 
from a teacher presentation book. The concept content includes 



such things as comparisons (the glass is full, the cup is 
* empty); positional words (the paper is on the book, the dog 
is 'under the table); classification (a dog 'and a mouse are- 
animals); etc* The 1976 edition has an "action track" in 
^ which children 'follow -simple commands- Use of physical actions 
and use of real objects to . supplement the picture presentation 
help add meaning, especially for younger children. 

• The IBI staff developed a. "Pre-DISTAR" series of lessons 
for Very young children (three and early four) in Spanish and 
•English. These lessons require children to make pointing res- 
ponses or oral responses that require only single words to two 
word phrases. This is used as a transition into the published 
DIST^JR which requires 'children to use whole sentences inures- 
ponding almost from the beginning lessons. v J" 

Lessons are given in each language to pr^s^hool children, 
~at least 20 minutes a day in Spanish and^afiother 20 minutes a 
day in English. In this way childr^TTiearn the meaning of the 
concept in their primary langu^g^, and it is then reinforced- 
ak they learn the vocabulary^in their. second language. In 
\addition to thefee lessoj^periods , two or three unstructured 
* learning periods (chiad choice) 'take place each day, and concept 
learning activities using a variety of common preschool play , 
materials take/place in these periods. 

PROJECT RESULTS: Figure 1, which follows, shows the average score 
by age l*evel expressed in terms of percentile rank (using 
national norms) f or' f bur groups: the project norm group, the 
national norm group, and two groups of children from' the IBI 
program (100 day test group showing, short terra !, program effect, 
and 200+* day test group showing longer term program effect). 

The project norm group average score is well below the 
national norms for this test—almost in the bottom third com- 
pared to children in r the national sample. Ihis represents ^ 
the expected level of. achievement project children would have 
had without the bilingual program since it is made up of pre- 
test scores of children who started the program at different 
age levels. Scores on t£is test have been pooled for children 
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y whose primary language was Spanish or English as there was found 
to be no significant difference based on language classification. 

The short term Bilingua^. Group '(100 day attendance) has an 
average— score just at the national norm (50th percentile) at age 
_four. It is slightly above the national norm at age three arid quite 
a bit above the norm at age five (66th percentile) . This group 
was included in the analysis because many^ school districts serr 
ving biljuigjaal- do not have such dhildren for -a 

-—tXxTl school year. 1 If th^£e school districts are .considering 
use of the IBI curriculum, this represents the effectiveness 
oven after a period of fivfe months or less program attendances 
The statistical analysis was done on raw scores (test scores 
details c^re shown in Table '4 in the Technical Appendix). ' As 
noted, even the sho^t term "p^o^ram effect produces a superiority . 
that is statistically significant at the .01 level (e.g., 
possibility that this much superiority would occur by chance less 
than 1 in 100 k. W , 

Th<* long term Bilingual Group (tests after 200 days in. 
attendance) era markedly higher than the project norm group, 
higher than national norms and higher .than the short term bilin- 
gual group. The percentile rank is in the top thii^f compared to 
national norms . . For'jMve year olds the percentile rank (78th • 
percentile) ts m the iop qu^rtile by national norms*. The 
superiority for the 200+ day attendance group over the project 
norm g^oup (expected performance without the program) is * 
4 statistically significant beyond the .001 level (possibility of 
* occurance by chance less. than one in 1000). 

It is possible for differences- in test scores to he statis- 
tically significant even when they are pot particularly educa- 
tionally significant. If a difference between groups exceeds half 
a. standard deviation there is a "rule-of-thumb" standard -that this 
much 'difference would be considered educationally significant . ♦ 
At each level, as shown in Table 4* in the Teohnical Appendix, the 
superiority of scores by children in the 200+ attendance group is 
more than one full standard deviation higher than the average score 
of the project n<j>rm comparison gro up. This would ind icate that the 
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gains made by children are educationally significant, .and that the 
IBI program is quite powerful j.n bringing children up' to and above 
national norms on the type of school readiness skills Measured- by 
this test, 
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Shaded .area 
represents 
50th percen- 
tile on 
national norm 



AGE 3.0-3.11 4.0-4.11 5.0-5.5 



National 

Percentile' 

Scores: 



IBI 200+ Day:. '69th" 
IBI 100 Day: 53rd 
Project Norm: 30th 



67th 78th Percentile 

50th 66th Percenti-le 

35th 43rd Percentile 



♦Statistically significant at .01 level, over project norm group 
♦♦Statistically significant at .0*01 level oven: project . norm group 
Detailed test scored analysis is shown in Table 4 in the Technical 
Appendix. •». — », 

Figure 1, Mean raw score on Cooperative Preschool Inventory, -by 
•..age groups and period of attendance in ibi bilingual 
program, compared to national norms, 

TO SUMMARIZE THE "FINDINGS IN FIGURE fe . - 

1. Without the program, project children in the. norm group " 
score well below average compared to the national norm 
group for this test, 

. - 2. The short term attendance in the bilingual program (100 days) 
' brings children -about eyen with the national norms at age * 
.three and four, and into the top third of the national 
norms. by age five, " 

3. Long term attendance in the bilingual program (200 or more 
days) means children average scores in the top third by 

. the national norms for this test at ages three and four, . 
and in the top quart i le for children- at age five, ... 

4. the superiority of children a.fter attendance in the bilin- , 
gual program over the project norm group is statistically 
significant (,01 level indicates the possibility that this 
mjl£h superiority would occur by chance is less than one in 
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• GOAL 2. CHILDREN LEARN HANDWRITING SKILLS. 

4 

THE NEED: , IBI teaches handwriting as part of the preschool reada.- 
« n'ess' program. . The project -measures children's visual-motor 

coordination skills by means of the preschool level of the 
Spelling subtest of the Wide Range Achievement Test. In 
this test the. child is asked_tq copy 18 marks of increasing 
' difficulty .and print two letters of his name'. A percentile 
. ranking of scores is available for five-year-olds.' The average 
. score by project five-year-olds when pretested is 7.^ : which . 
, . place's them at the seventh percentile compared to national 
• norms, e.g., only 7 percent' of the children tested at this 
age nationally had a score this {low or lower. Norms are not 
available for children younger jhan five. 

THE IBI CURRICULUM: IBl uses a handwriting curriculum developed 
by the "University of Kansas for their Follow Through and 
Head Start programs/.' These consist of^a Series of 29 ditto ^ 
masters from which/practice handwriting sheets are duplicated 
by the project. With these the "children shape their hand- 
writing skills to greater levels of coordination. Each child 
can work at his own pace through these materials. ' After 
completion of the "levels" as-/ the University of Kansas materials 
are called, the children go into "a project adapted version of 
a handwriting series that is now* 1 out of print, Lyons and 
s Carnahan "Write and See." The project has resequenced these 
materials and added in-book tests which teachers can use to 
check children's ability. 1 For the youngest children not yet 
ready to hold a pencil, pre-handwriting exercises^ are given 
using chalk-, crayons', etc. Children learn left-right sequen- 
cing and working- from the top to the bottom of a page from 
this curriculum. Lessons approximately 10 minutes in length 
are given daily to preschool children. 

v 

t PROJECT RESULTS: Figure 2 -which follows shows the average scores 
of children when they enter the program," of children who have 
had 100 days Attendance, and children who have had 200+ days 

-em; . ' 33 ' ■ 
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attendance* (Additional statistical detail is shown in 
Table 5 in the Technical Appendix,) Each added period of 
attendance "shdws a sharp increase in skills, for each age 
group. National norms are available, only for the children' 
in the jEive-year-old group. As noted before, the average 
score of the children on pretest places them at the 7th 
percentile by national norms (only 7 percent of children in 
the national sample had. scores thie low>. Children with 200+ 
days attendance have a 'score which ranks them at the 50th 
percentile. In. summary, children who would have showed a 
severe 'deficit in 'this area are able , through the indivi-** 
dualized program, to reach school-age with skills up to 
national norms . 
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Project 
Norm Group 



Bilingual 
100 days 
attendance 



Bilingual 
200+ days 
attendance ' 




AGE 3, 0-3 ill HANDWRITING SKILLS 

/. Mean Raw Score ' 

,6*- - 

4.4* 



AGE 4.0-4.11 
3.0 




6.0* 



9.2* 



AGE 5. .0-5. 11 



Scores in parentheses 
represent national • 
percentile rank . 



* 7.4 (7th %ile) 




11.4* (23rd J %ile) 

15.1* (50th %ile) 



*The 'superiority of this score over the project norm group 
of the same age-i£ statistically Significant beyond the .001 
level. Detailed test scores analysis is shown in Table 5 in the 
Technical Appendix. . , 

Figure 2. ffau raw score after various Periods of attendance by IBI 

PROJECT CHILDREN .ON SPELLING SUBTEST OF WlDE RANGE 

Achievement Test. . 
TO SUMMARIZE THE FINDINGS IN FIGURE 2: , 

1. . The individualized handwriting curriculum used by IBI 

PRODUCES STEADY, IMPROVEMENT IN CHlLDRHTS SCORES THE 
LONGER THEY PARTICIPATE IN THE PROGRAM, 

THE "aAINS ARE STATISTi CALLY .and educationally signifi- 
cant EVEN AFTER 100 DAYS (SHORT TERM INTERVENTION); 
WITH THE SUPERIORITY EVEN GREATER- AFTER 200 DAYS. » 



2 



Based x on national norms for this test, children enter 
the program with an extremely low , level of skills c/th 
percentile)^ By_200+ days attendance their average 



rtKttmiLtAi' J3Y ZUUT DAYS ATTENDANCE THEIR AVI 
SCORE IS AT/ THE 50TH PERCENTILE, BASED- ON NATIONAL NORMS 

(Norms are not available below age five.) 
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GOAL 3. SPANISH SPEAKING CHILDREN WILL IMPROVE IN SPANISH. 
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THE "NEED: The need for continued instruction in Spanish is based 
"on the expressed wishes of; th^e families whose children are 
served by the program. They want. their children to keep their 

a, 

Spanish language capability and to improve it. 

THE IBI CURRICULUM: ' 

Curriculum Materials Used : IBI field\ tested' the S^nish 
Sedition of DISTAR Language I, translated for IBI by Bilingual 
'Mini Schools, a private corporation which has a license to sell 
the Spanish edition ^granted" by S-RA. The project selected these 
materials because they are very well programmed; that is, each 
Tiew skill is practiced many times and then- refused, as new 

skills appear. All skills a£e cumulative; they never disappear 

✓ " j» w 

'from the material. And because it is well programmed the 

* * * [/ 

'children do not make frequent errors. ~ 

Spanish DISTAR^is taught, in a smail group from -a teacher 

presentation book which clearly outlines the dialogue used in 

teaching- 1 -* feature 5 which is very helpful to a paraprofessional 

teacher* .It involves a fast paced verbal exchange in w|p.ch 

Children would be expected to make ftbc^ 150 to over 200 language 

"responses during a 20-minute lesson period* Because the 

language responses 'require both phrases and whole sentences, 

*t*he children, learn to use the language with all its connecting 

words instead of learning > an isolated vocabulary which often 

occurs -with other language approaches. 

The IBI program acfcepts <rery young children, age three J 

and four, for whom, a -curriculum cali^d "Pre-DISTAR" has been- 

developed by the project. This curriculum begins with action 

responses and then requires one~ or two-word responses. Children 

can use it who are not yet ready for whole sentence responses 

required fn the regular DISTAR series. Pre-DISTAR is in both 

* Spanish" and English. * * 

Lessdn periods in oral Spanish, of approximately 20 aninutes 

per day are given all children in the preschctol program and up 

to first grade* (frISTAR Level I is appropriate* to, the firsts 
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grade level. Level II is not yet available, so the project 
is waiting to extend the oral language program to the older 
school age children.) r ' ^ 

In addition to the^ lessons in oral* Spanish, all staff are 
bilingual and use both Spanish and English in the teaching of 
other subjects -and in informal conversation throughout the v 
day. , ^ 

PROJECT RESULTS,: Te^tr results* are reported separately by the 

child's primary language classification in Figure 3 which 

'follows. These -test results indicate that children whose 

primary language is Spanish have scores two to three times 

as great on this* test than those whose primary language j.s 

English.* However the /average scores of children after 200 

days attendance improve within each language group. 

Table 6 in the technical appendix give^ the statistical 

detail of the Spanish vocabulary test scores. As, indicated , 
* * 

thfe superiority in Spanish of children after 200 days in the 
IBI program is statistically significant at age three, four 
- • 4 ,and five, over the project norm group of the same age* and 

language dominance. At age six the average score of English 
dominant children is superior to the norm group, but because 
of high^ variance within the group the difference is not sta- 
tistically significant. The average score p£ six. year old 
Spanish dominant children is the same for both project ^nd 
norm group. One possible explanation of this is that only 
level one of the Language curriculum is available in Spanish 
(there are three levels in English and the curriculum is used 
'up through third grade). The Spanish ' dominant children move 
through the curriculum in Spanish much more quickly than 
through the English curriculum and many who enter the IBI 
program as preschoolers have completed the available curriculum 
* before age six, The project hopes to have the second and third 

levels of the curriculum available in the future which would 
% enable the ' continuation of formal instruction in Spanish to 

a higher age level. * - 4 

* * * * * *- 
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^Project 
VjNorm Group 



ilingual 
00+ attendance 



SPANISH VOCABULARY SCORES 



Children whose primary 
'language is Spanish 34**" 



28** 
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AGE: 3.0-3.11 



4.0-4.11 



5.0-5.11 



6.0-6.11 



SPANISH VOCABULARY SCORES 

_ Children whose' primary 
language ' is' English 




AGE: 



3.0-3.11 



4.0-4.11 



5.0-5.11 



6.0-6.11 



- *The superiority of thl^ score ovter .the project norm group 
is -statistically significant at the .fll level. 

♦-♦Superiority over project norm .group significant at .001 

level. ' _ , 

* Scores of children after 100 days attendance used because 
pf an insufficient number of 200+ day tests for analysis at age three, 
Detailed test scores analysis is shown in Table '6 in the Technical 
Appendix." „ 

Figure 3. Mean raw scores in Spanish vocabulary on. IB I translation 
of Form B of the Peabody Picture Vocabulary Test by 

PERIOD OF ATTENDANCE. AND PRIMARY LANGUAGE CLASSIFICAT*^ 

TO SUMMARIZE THE FINDINGS IN FIGURE 3; 

1. Both Spanish and English dominant children showed gains 
__— , in. Spanish under the IBI curriculum. 

2. Compared to the average scores of the project norm group 

OF THE SAME PRIMARY LANGUAGE CLASSIFICATION, THE SUPERIORITY 
AT AGE THREE, FOUR AND FIVE IS STATISTICALLY SIGNIFICANT, 

- : ' ^38 . , 
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GOfyL 4, SPANISH SPEAKING CHILDREN WILL IMPROVE IN ENGLISH. 



THE NEED: When children enter the IBI program they are given the 
Peabody Picture Vocabulary Test in English -and in Spanish, 
using different forms of the test. Based on these entry tests 
for project children, 73% have a higher score in Spanish 
than ir* English. Of these children 46% have a pcore so low 
in English that it is within the range that could be obtained - 
by guessing, and would be considered Spanish monolingual, 
as showit-in Figure 4 (below) . Even the children who are 
classified as English- dominant are, ^ in fact, very limited in 
fc vtheir English skills* 




46% Spanish 
Monolingual 



26% Spanish 9% T5%~ 
Bilingual English English 
Bilin- Monolin- 
gual gual 



FIGURE 4. Language • class i f i cat i on of chi ldren enrolled in IBI 

PROGRAM THROUGH APRIL, 1978 BASED ON ENTERING SKILLS 
IN LANGUAGE. 4 



IBI 



ERLC 



CURRICULUM: Asf described earlier both English and Spanish are ■ 
taught each day (sometimes every otherL_day depending on the 
length .of time* available with the children at a particular 
site). The D I STAR Language curriculum is used. This is 
carefully programmed, provides f^st paced oral language prac- ' 
tice, use of the language in context and' in whole sentences. 
The context of the lessons involves- language useful to under-* 
standing school usage vocabulary, .reasoning skills, and * 
readiness concepts. * ' 

The. English Language curriculum is ayailable from SRA at 
three levels and is used through third^grade (the project only 

to third grade) . Children are started .-on the program at 
the preschool ages. If tY\e children are v^ry, young they started 
in the IBI'. ' 

39 . \ 
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r i t, 

Pre-DISTAR curriculum. This shapes their ability to 
4 follow a teacher presentation in a small group, respond ♦ 
'when -askefl, and starts with pointing responses .leading 
into responses that require use of one or two words. 

In addition to .lessons in oral Spanish and English r 
both languages atffe used in teaching other academic subjects 
and informally interacting with children during child 
choice activity periods, group activities such as singing, etc. 
PROJECT RESULTS: Figure 5 illustrates the superiority in English ' 
vocabulary scores by IBI Spanish dominant children after 
different periods of program attendance over the spores* of 
Spanish dominant children, of the same ige in the project * m 
norm gxoup. *■ • ° \ 

The project norm group scores represents the level of 

English children of different ages had before they had a 

chance to participate in the bilingual pro-am. Many migrant 

■ programs can only serve children for a. short term, so the 

scores after 100 $ays attendance shows the "short term" 

effectivemess of the IBI program.' Even within this limited 

time peripd English scores' increase to a level that is statis- 

•tically significant &t the .001 level. The scores of children 

after 200+ days is almost twice that achieved in 100 days in 

& • 

\j 'ther IBI program. 

A rule-of- thumb measure of when a difference in scores is ' 
enough to be considered "educationally" significant -is when the 
spread between the scores is more than half a standard deviation 
As shown in Table 7 (see Technical appendix) the gains of 
0t children in the tt IBI program are two or three times 'more than 
this standard and would therefore^ be considered very large 
*. gains for the period of program intervention involved. 



ENGLISH VOCABULARY SCORES 



Bilingual 
200+ days ' 
"attendance 



WlttMIIU^IIHIIIM* 

Bilingual 
?.• .- J.or> iflays 
attendance 



44* 



•Project 
tfqrm Group 




3! 



55* 



AGE 



3.0-3.11 4.0-4.11 5.0-5.11 6.0-6.11 7. 0-7,11 " 8.0-8.11 



r *The superiority of this score over that of^ the project 
.norm group of the same age is statistically significant beyond 
the* .001 level. Detailed test scores analysis' is shown in 
Table 7 in the Technical Appendix. - 

Figure 5. English vocabulary scores' on Form A) Peabody P'icfuRE 

VOCABULARY TEST, OF CHILDREN WHOSE PR I MARY* LANGUAGE . 

is Spanish, by age and attendance group, 
TO SUMMARIZE THE FINDINGS IN FIGURE 5:\ - > 

1. Comparison to the average scores in English of -the project 
norm group shows significant superiority for bilingual • ' 

, ... PROGRAM CHILDREN 'AT EVERY AGE LEVEL IN ALL CASES THIS ' - 
orCSi°^I Y ^SUFFICIENT TO BE STATISTICALLY SIGNIFICANT 
, BEYONDJHE, .001 LEVEL (E,G,, AN EXCEEDINGLY SMALL POSSJ- 

• BILITY THAT THIS MUCH DIFFERENCE WOULD 0€CUR BY D4AtiCE) . 

. r . 2, Chh_dren after 200 days Attendance are markedly superior 

TO THOSE TESTED AFTER ONLY 100 DAYS* ATTENDANCE, INDICATING 
THAT THE GAINS IN ENGLISH ARE PROGRESSIVE' THE LONGER THE 

• PERIOD OF ATTENDANCE, 



" <~ - & 3 6 

C-OAL 5.- CHILDREN ^^jj&r INCREASE. THEIR ■ SKILLS IN MATH. 

THE NEED: IBI uses the Wide Rarclge Achievement Test, math subtest, 
to medsure/children's skills in math. This is a nationally 
standardized test., Based on the national norm group, the 
average score of children before attending the bilingual 
program was at tHe 9th 'percentile at age five, and at the 
19th percentile at ages six, seven and eight. This means 
that only 19 percent of the children in the national nonit 
sample had scores. this low of lower. It indicates that 
without the program this target population would have been 
expected to be far below national norms in math. 

THE IBI CURRICULUM: The IBI project has developed and published 
a pre-math curriculum in Spanish and English fdr the pre- 
school ag$. children. This is taught in small groups and in 
math' related, independent activities. Children learn numeral 
• recognition,' counting sequence, making sets, the ^concept of 
equal, etc. 

After the pre-math series children begin using consumable 
- workbooks published by Random House under the trade name (^f 
Singer '"Sets and Numbers." This curriculum .is based on set * 
theory ^nji is taught in units. IBI uses this 'series up 
through third grade (the upper level in this series uses 

hard cover books instead ^of the consumable workbooks) . 

•-I ^ 

These math materials can be* completely individualized 
and a .teacher' can successfully work withra group all of whom 

may be on "different pages or .even in different books. Because 

i i * » 

of * the disruptions in schooling experienced by a migrant 
pojDul'^tion , the project used as- one important criterion in the 
selection^ of curriculum materials whether the materials can * 
be individualized. 

The Sets and Numbers series are published in English 
only. This\Jias presented no ob&tacle m ^tiheir use by ^bilingual 
students taught by bilingual paraprofessional teachers. The 
teachers use both Spanish and English working with the students 
for .injstructipr^ , praige &fid correction. English terminology 



is u,ed for the mathematical terms and ^ .. 3 

are neK concepts to ^ ^ ^ . thes, 

T 

Test was g iven to project children- ±n ^ glis h or in Spanish 
. (Project transition, , It was £ound that ™. 

-J« factor on the test^ana that there were L ^ f ".« ' 
differences in pretesh «=o«>. Q c * ■*w«»ont 

pretest scores accumulated fmrthe n™-^*- . 

Abased on la„ guage dominance. Therefor" I te s CO rT • 
• • in math were pooied for analysis. 6 

-children H/ OT Pl9Ure 6 °" ( ° ll0Win9 P ^ sh °« *•* 
. children Mthe P r °3ect no™ group averaged scores far below 

the natrons! nor,.- Short te™ project attendance ,100 daysT 
produced higher scores at every age level The . 
after inn a ■ leve >- The superiority 

. after 100 days „ statistically significant for children 
. age three through six. 'The difference is nn, t 
statistically significant at " ^ ±S n0t e > nOU * h to 
. . t . ? i ant at ages se . v en and eight. - For 

statical detail Isee Table" , i„ the Technical' A p Pe ndi x . .. ' 

. Children who attended the nil prVem (or 200+ • • - . 

s ores markedly higher than either the project no™ group 
,or children tested after 100 days attendance. The average ' 
below alS ° abOVe ' nati ° nal age seven, si gh tly 

ee Tab t ^ " ^ 6i9ht ' "* ^ 

see Table 8 in the Technical Appendix. - 

, ; Without the P ro g ran, the avera g e score in meth achieved 

- r^ort;? 6 : was beiow the ' mh p ™ iie ■* » ' • 

200 avs L " billn9Ual ^ 

days, the percentile scores ran g ed from 42nd to the 68th 
percentile at different a g e levels 

statis T tLair ri ° rity ° f SC ° reS after ' 20 ° + dayS •'*«—• -s ' 
eight b I S h 19nl(lCant ' at level, three through 

eight beyond the ..001 level of si g »i fi<Jance , (th . possi J Uty 

.that Wis much superiority would occur Ty c h a „ oe less than 
one in 1000,. See Table 8, Technical tha " 
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Using the riile of thumb that a score more than half a 
p I, , / 

standard deviation higher £han the reference group would also 

ba considered educationally significant , the superiority, of 

children at every age level in the, bilingual program with the 

minimum 200 days attendance would be considered educationally 

significant. At all but age eight the difference is more 

than one full standard deviation l^Lgher than the reference 

project norm group of the same age. 
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MEAN RAW SCORES IN MATH 



Bilingual 
200+ days 
. attendance 



Bilingual 
100 days 
attendance 

Project 
norm/group 
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RAW SCORES 
SCALE 



6 7 8 

• _ . , National Norm = 100.0 100.0 100 0" inn n 

Mean Standard Scores IBI 200 day = 104.6* 107.3* 101 3* 97*2* 

IBI 100 day'= 94.7* 96,6* 91.8* 90*8 

Proj. Norm =80:5 86.8 .86.9 87.6 

, ho superiority of th?s score over' the project norm group of 

SSafSS SL^ tatiSti ? ally si ^ificant beyond' the .001 level. 
Appendix. analysxs is shown in Table 8 in the Technical 

Figure 6. Scores on the math subtest of the^Wide Range Achievemfnt 
Test, by age and period of attendance i n IBI prSgrIm 



TO SUMMARIZE THE FINDINGS IN FIGURE 6V 



l ' lil H onl JJil BILINGUA L PROGRAM SCORES OF TARGET CHILDREN IN 
THE PROJECT NORM GROUP ARE FAR BELOW NATIONAL N^RMS. 



2. 



Short term attendance (100 days) in the bilingual program 

AT EVERY A H GE H L?VE^ R 2n G WPv^ R , E ?r^ A S PRQJEC G T A NOR P M°GrSKp 
AT EVERY AGE LEVEL ) HOWEVER STILL BELOW NATIONAL NORMS. 



3. Children in the IB! program for 200 or more days scorehighfr 

AT EVERY GRADE LEVEL THAN EITHER THE PROJECT NORM GROUP OR 
CHILDREN IN THE BILINGUAL PROGRAM ONLY 100 DAYS? ?HE 
' IvERY^GpVeSf. ^FIt!?????^ THE PROJECT NORM GROUP AT 

level. statistically significant beyond the .001 

^* It!! iS BI BILI NGUAL GROUP WITH 200+ DAYS ATTENDANCE ALSO 

LEVE R f S GE |xCE C pf AGE™,^ NATI ™ AL ^At'alCIge ■ 
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GOAL 6. CHILDREN WILL GAIN READING SKILLS IN ENGLISH. 

* • » 

THE NEED: Children are tested on the reading subtest of the Wide 
Range Achievement Test for English reading. Tests are 
analyzed separately for children whose primary language is 
English and those whose primary language is Spanish because 
children differed significantly on their'entry skills on this 
test based on language group. * ; V 

* As shown on Table J? in the Technical Appendix, ,the ehtry s 

level scores of children in the project norm group whose 
primary language was English were below the 25th percentile 
by national norms. The norm group scores, of children whose 
primary language w&s>Spary.£h all averaged below the 10th 
percentile by national norms (e.g., ten percent of children 
in the national* norm sample had scores this lgw *or lower. 

THE IBI CURRICULUM: The preschool reading program in IBI is started 
at about age four using the University of Kansas Reading Primer 
which was develpped for the Behavior Analysis Head Start and 
, Follow Through programs* The teacher holds a teacher presen- 
tation book and children sit in a semi-circle around the 
teacher. Children learn to^respond to pictures going from 
left to right and from the top to the bottom. of the page, and 
th4 basic, skill of r bleeding sounds. With these word attack 
skills the children are then able to begin in # the Sullivan' ., 
programmed reading series, published by MfcGraw-Hill. ' 0rfc6 
into the Sullivan program, "the children can 'work at their own 
pace in an individuialized-ptogram. 

The" Sullivan materials" use a phonetic approach with a 
\ controlled vocabulary so that the beginning reader only Was 

T to remember one sound for each letter (except for a limited 
number of irregular wQrcis which are taught as sight words). 1 
This feature of the .curriculum was fpund^ to be especially 
helpful* to children whose primary language is Spanish^. It 

— — means— they-do- not- have -to^-cope with the many different sounds* 

which letters take in English until after they h$ye mastered 

, the ginning re,i» g ..KiUl.o t wo,* attac*. ? „ai„,, etc. . 
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The curriculum is programmed so the new. material is 
introduced slowly with continuous* review of. what has been 
learned before. The picture illustrations , are clear and 
uncluttered which is helpful to comprehension of a child for 
whom English is a seqond language. 

The teacher circulates children -working in a small group 
at a'tcible. Workbooks are starred by the teacher for new . 
sounds and children raise their Jiands for assistance, when 
they come to a star.' This enables the teacher to help the 
child with the new sound on a one' to one basis. The child 
repeats the sound so the, teacher can check that the child is 
both hearing and making the correct sound when it is first 
encountered. TJhis 'avoids the confusion Spanish speaking children 
may have in distinguishing sounds in English that are not found 
. in th^e Spanish language. The teachers are also trained to ask 
many comprehension questions as they check children's work, 
and. can make explanations in Spanish if there is a comprehension 
problem. * ; 

A teacher is easily able £o work with a small group of -* 

• * **" 

children each working on a different page, even in different* 
.books (there are 2 \ books, in the Sullivan reading series). 



PROJECT RESULTS: Figure 7 which follow illustrates 'the effect of 

the* IBI program on the English reading scores of children Whose 

primary language is Spanish. 'The shaded area represents the 

* 

national norms for this test at each- age level. Line A repre- 
sents the scores of the. project nqrm group, i.e., .the expected 
score by target group children without benefit of the bilingual 
program. As can be seen in the, graph the project nofm group's 
score are far below the national norms, and the gap widens as 
the children get older. ? 

Children in the IBI program 100 days sco^e higher 'at 
r • Ff 

every age level than the project norm group. I Children in the 

IBI program for 200 or more days have average scores higher' 

than the 100 day test group, and much higher than the project* 

norm group. The statistical detail for these scores is given 

in Table in, the Technical , Appendix. The superiority of the 



children in the bilingual program 200+ days over the pf£^ec?fc 
norm group is statistically significant beyond the .001 level 
in each age group* „ . 

At v dU age levels the score' of children *n the Di 1 ungual 
program is somewhat below national norms; however the' averse 
score comes closer to the national norm && the children set 
older. , The mean standard. scores for each group ore reported 
Under the graph in Figute 7. The. national poor) it\ standard* 
scores would be 100 for each age level. AS noted o*> the <jraph> 
the IB'J children in the 200 day test group h*d a mean atandaird 
score of 9S at ages five and six, 97 at a^e seven, and 99.4 at 
age eight:. . * 

. In terms of percentile scores the project norm group . 
scores were at the ^8th and 9th percentile in reference to the 
national norms tor this test. The bilingual program children 
after 100 <Jayfe averaged scores between, the 14t£ and ISJtfo per- 
centile. After, 200+ days, the scores of Children mnged 
between the 37th percentile at age five and the 47th *peoaerati]e 
at age eight. \ 

Figure 8,, which follows, and Table 9 in the Technical ■ 
Appendix, present .comparable data for children In. the IBI 
^program whose primary language is English. IBI accepts rela- 
tively few children who are En£lish dominant an4 these elmosfc 
entirely at the preschool or kindergarten level.. Tor -the ages 
and attendance groups in which there were a Sufficient number 

of tests for analysis (a minimum of ten) tha pattern is 

> * 

slimier, only slightly higher, than the* corresponding Scores 
Tor Spanish dominant children. The expected level of scopes 
without the program, represented by the project norm group, * 
is far below national norms; 19th percentile for 4ge fts/e . 
. and 25th percentile at aga'seven. Group mean, Scores ai>e - 
higher after 100 da^s in the IBI program; 39th percentile at 
age five and 30th percentile at age six. The IBI children 
with at least 200 days had the highest scores; 42nd percentile 
at age five and 55th percentile, e.g., above the; 'national 
norms, by age six. The' scores after 100 days wefct Signifi- 
cantly higher (.05 level) than the proje.ct norm jrpup'. ' The ? 
superiority after 200 days was statistically significant 

•beyond tha .01 level. - 48 
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• \ 5 
AGE? 

Mean . 

Standard 

Scores 



m 



ii* 



;.;.v. 
Mm 



4 5 ■ 

National Norm:. 100 . 0. 
IBI 200+ day:' 95.4* 
IBI 100- day: 84.2 
Project Norm: 79.1- " 



• 6 


7 


8 


100.0' 


•100.0 


100.0 . 


95.2* 


96.8* 


, 99. '4* 


83.7 


86.9 


88T 7 


80.1 


79.2 


79.8 



*The superiority, of this score over the project norm group of *** 
the same age* is statistically significant 'beyond the .001 level. 
Detailed- test scores analysis ds shown in' Table 9 in the Technical 
Appendijc. / * • ' 

Figure 7,. 'Mean raw scores and standard scores, of IBI project children 

BY AGE AND PERIOD OF ATTENDANCE ON THE READING SUBTEST OF ' 

the Wide Range Achievement Test. . 



TO SUMMARIZE THE FINDINGS IN. FIGURE 7: 



2, 



Project norm group scores indicate That without the bilingual 
program children whose ' primary language is spanish would be 

EXPECTED TO HAVE READING SCORES IN ENGLISH FAR BE LOW. NATIONAL 
NORMS, - , / 



IN. HIGHER SCORE* 
HIGHER SCORES AFTER 



rt AT EVERY AGE LEVEL 
:00 DAYS, WITH THE 



The IB] curriculum results 

AFTER ,100 DAYS, STILL HIGH 

SUPERIORITY AT 200 DAYS STATISTICALLY SIGNIFICANT BEYOND 
I H In'1000^ EVEL (P0SSIBILITY 0F CHANCE OCQURANCE LESS/ THAN 

3, After 200 days in the bilingual program, the mean standard 
• scores of children are within the 9.0-109 RANGE considered 

AVERAGE BASED ON NATIONAL NORMS. 7 



READING SCORES OF CHILDREN WHOSE 
PRIMARY LANGUAGE IS ENGLISH 
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Bilingual 
20*0+ days 
attendance 



NMINMIIMHimilH: 

Bilingual 
100 days 
attendance 



Project 
norm group 
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RAW SCORE 
SCALE 



"Mean Standard, IBI 200 days: 
Scores' (Based IBI 100 days: 
on Norm of .100) Proj. Norm: 



97.6** 

96.4* 

87.3 



102.5 
92.3 
(-) 



*h* Hl he 5u Pf rior fty>f tHis 'score over'the project norm group of 
|he same age is "statistically significant at the .01 level Detailed 

^ St f fgnlffclSTt i S 05 Sh l» Table ^ the TechniSS^SS^ 
rjr) Les>thanr8:in group, too few for analysis". 

Figure 8'. - Raw scores and standard. scores of IBI project children by 

. ■ ffii^ija^s^jg^^s?? ™ ™srsg4s? E SF BY 

' TO.SWHARIZE THE FINDINGS^IN FIGURE 8: , 

1. The project norm group scores for children whose primary 

* ^TOE NAtfoN^NOR^orTOIsSlsT COMPARED 

100 OR ^ DAYS 18 STATISTICALLY S^jg^lff^ggf „ " 



THE PROJECT NORM GROUP. 



3. After 200+ days attendance, 

102.5 whic 
100,. 



STANDARD SCORE OF 102.5 
NATIONAL MEAN -SCORE OF 



CHILDREN AGE SIX HAVE A MEAN 
CH IS SLIGHTLY ABOVE THE 



AS EVIDENTH5R0M FIGURE 8 AND FIGURE 7 ON THE PRECEDING 
PAGE. "BOTH CHILDREN WHOSE PRIMARY LANGUAGE IS ENGL ISH 
AND THOSE WHOSE PRIMARY LANGUAGE ISJ>PAN1SH APPEAR TO 
BENEFIT FROM THE IBI CURRICULUM IN IMPROVED READING* 
SKILLS. 
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GOAL 7. CHILDREN WILL GAIN READING SKILLS IN SPANISH. 

THE NEED: The "IBl program teaches reading in Spanish based on* 
parents 1 wishes that children obtain the full benefit of 
their bilingual heritage through literacy in Spanish as well 
as English. 



THE IBI CURRICULUM: IBI uses Aprendiendo a Leer reading series, 
published by Behavior Research Lab. in Palo Alto. This is a 
parallel reading program to the' Sullivan Programmed Reading . 
in English. It has ^consumable workbooks in. which children can 
work independently at their own pace/ checking their own work 
through^the marginal answer column. The teacher moves' from 
child tfr-ehild introducing^ fiew sounds, asking comprehension 
questions., an& hearing children read aloud as Jbhe accuracy of 
the child's work is checked., There are only six workbooks 

• in the Spanish series (compared to 23 in English) , since 

* the authors feel children cai\ master the basic decoding and 

- word attack skills in ^Spanish much more easily thar\ in English 

because the sound-symbol system is much more consistent than 

it, is in English. , 

IBI developed its own Primer to teach the, prereading 

skills and introduce a set of, beginning sounds which the ' ,„ 
* \ V child can use to learn ^blending skills needed for working 

in-Jthg Aprendiendo^a Leer reading Series. .The need^to develop 

these curriculum materials delayed full implementation of a 
' Spanish reading program in the IBI project until the 19 77-78 

program ye*dr. , The 'IBI- primer is called £omenzando & Leer. 

It-is a direct instruction approach, taught from a teacher 
' presentation book with* the teacher modeling and requiring 

children to give "group responses, then individual responses 

to .check mastery. It is programmed with new material intro- 
duced gradually with continuous review of what h§fe been 

learjted before. 
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PROGRAM RESULTS: Building up a project norm group. based on ^pretest 
scores of children entering at different ages ^requires time 

' • : 52 



ERIC 



tohuld up the baseline data to numbers sufficient for statis- 
tical analyse. • As there are no »ea„i„gf ul noma lrm 
external, group to use as a »easure of expected progress 'by 
Project chrldren, the reading program in Spanish J., „„' 
have sufficient test data for analysis 
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GOAL 8. CHILDREN NEED TO LEAPN MORE OF THEIR CULTURAL * HERITAGE . 

/ ' "v^ 

THE NEED: The need for this instruction isSoased on 'a philosophical 
position held by the families served by the program that having 
» children appreciate a multicultural society is a useful educa- 
tional goal. . % 



THE IBI CURRICULUM: The daily schedule in an IBI program involves 
one or morel -periods of time in which children "are free t'o 
select an activity of ' their choice. Teachers prepare materials 
and plan activities £rom which the child may choose, add at . ' 
least two of the choices available each week will involve, somer 
thing related to "cultural heritage. In addition, once a 
week, or once every other week (depending upon available! time 
as this is a released time or after school program for, children 
7 of school age) an academic learning period is replaced by a 
teacher planned* cultural heritage activity in which all children 
participate. The project has prepared a book flps a reference 
source on activities, related to the Mexican culture (available- • 
to other programs if they wish to purchase ^it) . In addition it - s 
has prepared kits Vith materials and activity ideas related to , 
many world' cultures (Chinese New Year, Danish Christmas, etc.) 

* which have not been reproduced for general distribution. Kits > 
have also beefi prepared in reference to U. S. holidays and / 48> 
traditions. However, \h$ use of this scheduled, time is v ' > fi 
generally a matter of teacher choice and no particular content 

is mandated. * ' * « , > 

The IBI program uses adult paraprofessionals from the same' 
culttural group as the children served as its teaching -staff 
anu^onsiders this to be the main source of helping children 
have a £ense of cultural identity and fcple models wj^hin- their 
, own cultures. Recognizing that the songs and dances, holiday 

* traditions, etc. represent only the "trappings" of culture, IBI. 

* fielt.that since it was allocating time to familiarize children^ *. 
with these "trappings" it should measure whether there was any 
yield to the time spent. Available ^teq^s dealing with cultural 
knowledge seemed to be mostly geared to older children who ^ 
approached pultural enrichment in a social studies sense — lessons 



about history, hert>es, etc. Foe children preschool through 
third grad£ this seemed tbo abstract.. The project therefore * 
developed its owq test (BMHS Test of Cultural Concepts).' 
The test measures knowledge of U. S. and Mexican culture 
through clothing and food, sorjgs, dances and games, and 
holidays which have particular, meaning^ for young children. 
Detail on the test content, and validity and reliability data 
related to itsouse, is given in Appendix B. 



PROJECT RESULTS: Figure 9 which follows, and Table 10 in th^ Tech- 
nical Appendix,, document the gains, made by children in acquiring 
. the knowledge* of culture measured by thi-s test. , * 

The superiority of children tested after either 100 or 20'0+ 
• " days in the bilingual program over the project norm group 
(cumulative pretest scores) is statistically significant. 
Most of the gain appears witftifi the first 100 days although 
at every # age ' level there is continued gain^ so that the. mean 

, scores 'after 200 days are in all cases higher. The program, 
» * * 

therefore, appears to produce a measurable gain in knowledge' 
on cultural concepts. 
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Bilingual 
200+ days 
attendance 35 



Bilingual 
' 100 days 
atte^danfce 



Project 
norm group 20 




50 



AGE: 



6-7 



8-9 



♦Scores* given "are correct answers out of 44-item test . The' 
superiority* of the bilingual 100 and 200+ day attendance groups 1 * , 
scores over the project nonti group of' the safiie age is statistically 
significant beyond the .01 level. Statistical detail is shown in 
Table 10 in tl\e Technical Appendix. , , * 

Figure 9 ; . 'Man raw scores on the.BMHS Test. of Cultural Concepts 
by age and attendance period, . * 

TO, SUMMARIZE THE FINDINGS IN FIGURE 9: ' \ • 

» * r 

i 

1, Each period of. attendance in the IBI program produce&a 
greater knowledge of concepts related to children -s 
bicultural background. tost of. the gain- is made, within 

~ the first. 100 days oh. project attendance, '-\ 4 -; 

2, The superiority of children's. .scores: after either 100 
or 200 days attendance over the scores of children 
tested before exposure to the program is statistically 
significant, at each' age level, 
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GOAL"' 9 . CONTINUITY CHILDREN* WILL EXCEED COMPARISON GROUP. 



51 



THE NEED: The IBI prtfgram has " a mobile component which was designed 
to provide, continuity of educational instruction from one loca- 
tion to the next for children who must move during the school 
^year because the parents follow the crops. Suchjnoves make it 
"difficult for migrant children to learn basic skills such as . 
reading and math because the approach may be very different 
fW one school to the next_resulting in confusion. Each - 
curriculum has a dif fer*enrorganization so the child may miss ^ 
' concepts that are essential to later understanding. "Many areas 
to which 'the children move do not have a large resident popu- 
lation who are Spanfsh speaking, and therefore are not' prepared 
to offer bilingual instruction. The child has the anxiety 
. involved in adjusting § to a new school, new teachers, which 

im'pedes learning. • Schools may choose not to "use up" expensive 
workbooks for a child Expected to attend. six to eight weeks, 
so utilize less convenient and less attractive dittoed 
materials. At each, site it takes *ime fo* placement, 'assign- 
ment of materials, organizational tasks ,' tests and paperwork. 
All of these constitute the hardships of acquiring an education 
in a family following the crops which represent the need for 
an alternative; approach. 

THE IBI PROGRAM:. One component or the IBI project is the "mobile 

component!" .In this component children in the south Texas f , 
town of,La-Grulla are surveyed, to see what northern locations 
their families expect to move to durrng the migrant season. 
' ' -(Adults from migrant families going to an area where a cluster - 
• . ..of chiiaren will be going' are then recruited as teachers in. 
the mobile component. During the winter months the teachers 
are trained 7 and they provide instruction in the year-round 
■ *. center at the Texas site. . , 

V When the migration is about to begin, the staff "site * 
coordinator" travels north and lines up facilities for the 

' ^Continuity chi ldren are project children in the mobile compo- 
nent of IBI who were enrolled both in Texas and in one of more 
northern 'locations under mobile teachers who moved with them from 
site tq site. 
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preschool age children if no lo^aTl programs exist. If there 
are local programs either th^*site coordinator or another 
of £he v administrative stp^ff WQrks out a cooperative agreement 
whereby the mobile sjgf^f will be assigned to assist in the 
local program in /^turn for released time during the morning 
to continue tp£ bilingual instruction of the children being 
followed £i?om .Texas. Similar contacts are made with the 
schools^ Often the cooperating northern school will 'assist 
by .assigning all children in the IBI /program to the same 

W ' - * / 

school location and working with teachers to allow released 
time so children may continue the bilingual instruction under 
the mobile teachers for part of their schdol day.* Usually 
the schools arrange some space for this instruction as weill. 
Sometimes the school-age children must, be taught in the labor 
camp areas where the families liA/e in the .evening or after 
'school. * K 

" Most of the teaching staff from the Grulla site do 
relocate, to the north for part of .each year — some, moving to 
more than one location in the north before returning to Texas. 
All- of the* training and administrative stcJf f alsp relocates 
for part of the year — staggering the time they are gone in 
order to provide ongoing supervision of both the mobile compo- 
nent .sites (which are scattered in the north) and the Texas 
program which continues for a small proportion Of the children 
year-round. . - ' 

The mobile component is experimentally small — normally 
involving 60 to 90 children and a dozen or so staff members.. . 
At the .same time in some : years it has succeeded in following 
as many as 75% of the children who leave La Grillla* with their 
-families following the crops. It provides -the advantage of 
continued bilingual instruction for these children as an addition 
to the schooling they receive through the schools in migrant 
host communities. It enables them to follow the instructional 
sequence of the IBI curriculum wherever they left off (and 
special mastery tests keyed to all areas of the IBI curriculum 
are used to discover 'material they may have forgotten and need 
to review after an absence) . Children Have familiar teachers 
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for a£\Jeast part of the day to bridge the anxieties of 

changing schools. Through the IBI curriculum children 

follow one program approach in* basic -skills subjects for 

part of the day which makes it less important that the 

changing programs offered by the schools they attend may 

leave gaps and discontinuities. ; 

The educational program uses the same materials and 

teaching methods described elsewhere in this evaluation. 

PROJECT RESULTS': The "continuity"' group of children were Spanish 
dominant school-age children from the mobile component who 
had been enrolled in the program both in Texas and in* one 
0£ more northern locations, and who had been in the IBI 
program for at least 200 days. The comparison group children 
were" in kindergarten through third grade from a neighboring 
' community to k*a Grulla, Texas. Children in the * comparison' 
group were Spanish dominant, had approximately the same socio- 
economic level As IBI project children, and came from families 
which migrated each year in order to do seasonal farm work.* 
In making this special study in reference to the mobile cOm£o- 
nent the factor of migration is, held constant,: only IBI t ^ 

project children who migrated were tes£ed,'only comparison 
g^oup children who«migrated were tested* 

Figure 10 shows the vocabulary 'scores in Spanish and in 
-English for. the two groups. The IBI continuity children 
. achieve & small superiority in Spanish at each cjrade level. A 

In English the IBI continuity children achieve a great superiority 
over .the comparison grodp with the gap widening at each grade 
level. ^-By the third grade it will be observed that the mean 
score in English achieved by the children is only slightly 
below their score iri Spanish. - * \ • 

The superiority of the IBI continuity group in English 
is Statistically significant at every grade level over the 
scores of the comparison group. The superiority of the IBI 
continuity ^roup in Spanish is not sufficient to be statisticaliy 
significant^ However, the fact that the children in the IBI *\ 
bilingual program have maintained and imprpved their Spanish- 
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at the same time they have' greatly improved their English 
•is important in view of 'tlfe controversy „over "maintenance" 
vs. "transitional" bilingual programs. An underlying assump- 
tion' in this controversy seems to be that maintaining Spanish 
skills must necessarily detract from the acquisition of . . 
English skills. The findings in "the* IBI project do not 
support this assumption. . // 

Figure 11 compares Jthe continuity and the comparison 
group in their math and reading sqores. In every grade level 
in both- math and reading the superiority Q f the IBI continuity 
group is' statistically significant beyond the .001 level , 
(e.g., the possibility that this/much difference wouldv. occur 
by chance less than 1 in 1000). ) r 

The mean standard scores in m^th an<I reading are reported 
under the grade columns in the graph. These allow the com- 
parison of both' groups to national norms. On this test a 
mean .of 100 is used and scores ofv-from 90 to 109 represent 
,an average range in ref&rettce to the national' nomTgroup. 'The 
migrant children in the comparison group have scores fatr 
below t^*e> Average, range in reading in English, and slightly 
below the average range. in mathematics; a subject in which 
language is less of a factor. The IBI project children have 
scores within ^the average ratige in "both subjects. In mathe- 
matics their scores run above- the national mean in kindergarten 
and\first grad€, probably reflecting the participation of the 
children in the academic -preschool program. Because of the 
preschool program children ha$e .been able to acquire English 
skills'before reachirfg school age, a^d* e t<^ maintain pace with 
other children from the majority pul^ure and language in 
learning, to read. *As' must be expected, the scores -in reading 
in English of botlj groups closely, parallels £heir scores in 
English vocabulary. 'Qfese findings would 'seem to support the 
expansion of bilingual programs into the preschool years, so 
the child starts with a reasonable \,language facility and 
isn't 'playing ^catchup in the academic subjects that depend 
on English (e.g. , 'English language arts) • 
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*The superiority of this .score over the comparison group is 
'significant beyond the .00*1 level. Statistical detail is shown 
in Table"ll in-'the Technical Appendix. _ 

Figure 10. . Mean raw score on Peabqdy Picture Vocabulary Test, 
Form B in Spanish and Form A in English for IBI 

- CONTINUITY MIGRANT CHILDREN AND COMPARISON, GROUP 
MIGRANT CHILDREN, BY GRADE LEVEL, ' ' 



TO SUMMARIZE THE FINDINGS IN FIGURE 10: 



< 



1. ibi continuity group chi ldren .have higher mean scores 4 
in both Spanish and in English than comparison group 
children, at every grade level.* • 

2; The IBI group superiority is. statistically significant 
in English vocabulary; it is not statistically signifi- 
cant in Spanish. It indicates, however> the IBI children 

HAVE MAINTAINED AND IMPROVED THEIR SPANISH AT THE SAME 
TIME THAT THEY HAVE GREATLY IMPROVED THEIR ENGLISH SKILLS. 



r 



/ 



MATH' 



READING 



Bilingual 20 -j- 
"Continuity" 
Group 



^ Comparison' 
Group 12+ 




GRADE N LEVEL: ' K 
Continuity Group t 404* 
Comparison Gxpup:. 77 
Standard Scores 

*The superiority of this score over the comparison group of the 
same grade level is statistically significant beyond the .001 level. 
Statistical detail is shown, in Tabler 12 in the Technical Appendix. 



-Figure 11 



• Mean raw scores and standard scores 6n math and reading 
subtests of the wide range achievement test, for ibi 
conjinuiw group children and comparison group; by 
grade level', 



TO SUMMARIZE THE FINDINGS IN FIGURE 11 r - 

1. At every grade' level the IBI continuity group is superior 

IN BOTH MATH AND READING TO THE COMPARISON GROUP CHILDREN, 
IN EVERY CASE THE SUPERIORITY IS LARGE ENOUGH TO BE STATIS- 
TICALLY AND EDUCATIONALLY SIGNIFICANT. 

2 t Based on a standard scores mean of i.00, with 90 to 109 
considered an average range of scores in terms of national 
norms, the scores of the continuity group are within the 
. normal range at every grade level for both math and reading, 
Math scores in' the early grades are abcve the 'National mean.. 

3. The mean .standard score in reading increases with each grade 
level, roughly 'paralleling the gains in english skm.ls 
reported in figure 10, ' 
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INSTRUCTIONAL COMPONENT 

i 

'PROCESS GOAL 1.10. TEACHERS WILL FOLLOW APPROPRIATE SCHEDULES. 

v-> , f 

* . — t 

THE NEED: In order to meet instructional objectives, it is 

necessary to assure- thaC all subject areas are included in, the 
teaching program for at least a minimum period of . instruction 
time.". * 



PROCESS: IBI follows a schedule checklist indicating the curriculum 
areas that must be taught,- miniiftum time periods, and^ require- - 
ments related to order to Scheduling so that child choice 
- activity period can, be maximally effective in reinforcing effort 
ma^e ' during academic learning periods. Resource trainers 
monitor this at each site, and assist in making changes if 
.grouping needs to be different, building restrictions change-, . 
etc. The checklists are forwarded to the evaluator, as documen- 
tation of this process being carried out. 



FINDINGS: Resource trainers reported that schedules meeting. minimum 
requirements were carried out: at each site. Not all documen- 
. tation was forwarded to the evaluator; none at all from one 
site, so this goal is reported as "met," but only partially . 
documented. * . 
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PROCESS GOAL 1.11 f TEACHERS WlfcL USE APPROVED CURRICULUM. 

THE NEElD: The achievement of instruction objectives requires * 
utilization of the specified curriculum materials, or an 
b> approved substitute,, for each academic area. 

PROCESS: IBI utilized a weekly curriculum progress report form. 

This specified! the end of week placement of e&ch child in each 
curriculum area' and is filled out by the teacher and sent to 
_ the evaluator*. who maintains a tracking system for each enrolled 
child. This report also describes activities in the cultural 
area where there is no presequenced curriculum. These reports 
documents this proces's objective on { use of approve^ curriculum. 
. They arel also* used to trigger mastery testing, to give a~ place- 
ment for a child after a move, to monitor child progress and 
.report to trainers; e.g., the detailed tracking of -child pro- 
gress is an, essential management, tool in the implementation 
-of. the program. * * 

FINDINGS: There, documentation of the progress in the specified^ 
curriculum for each project child. The, specified curriculum 
is being fully implemented at all sites. * 



\ 
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PROCESS GOAL 1.12. TEACHERS WILL USE APPROVED TEACHING METHODS . 

THE NEED,: In addition to fallowing the approved curriculum an£ 
schedule, IBI feels' that instructional objectives will only 
be met if approved teaching methods are used, 

PROCESS: The project utilizes positive reinforcement classroom 
management procedures. After the teacher completes the .in- 
service training units on how to use these methods, the 
maintenance of these skills is monitored through use of moni- 
toring instruments. These are basedon actual observation of 
teaching; some" are time4^and all have a criteria for- passage. 
If a monitoring unit is not passed, the trainer reviews 
whatever .parts of the original training, seem to be needed and 
- does another "monitoring observation until; the teacher meets 
the. criterii on the instrument. 

•FINDINGS : • Trainers at all three sites have made regular use of 
monitoring training units, and over 80% of -ail teachers ". 
eligible for monitoring (e.g, r with the program long enough 
to have completed the requisite training units) have passed 1 
one/or more monitoring observations. > * 
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STAFF DEVELOPMENT COMPONENT" 

GOAL 2.1 TEACHERS "WILL MASTER IN-SERVICE TRAINING UNITS . 

\ - • 

THE NEED: In the IBI program the onlyv teachers working directly 
with the children *are trained paraprofessiorials — parents and 
relatives of the children served. - 

There were special reasons for designing a program that 
could be taught effectively by previously untrained bilingual 
adults. One was t£e shortage of available bilingual certified 
* * staff in the northern states (two year-round sites are located 
in Connell and Moses Lakja* Washington) . The other was the 
design of the mobile coroponent, which was .to utilize the only 
consistent* adults found, in the life of the mobile migrant 
child (his family and relatives) as teachers in a program 
that l would move, following the*' child. Previous attempts had 
been made to' 'recruit- certified bilingual teachers |or*such a 
mobile educational effort anc^this was^almost entirely ^ unsu<^*-* 
* cessful. The professional teachers were reluctant to move 
, their own , families during "the school year. They did not like 
the housing shortages and life \n general in- the remote rural 
areas to which the migrants moved , and they were sufficiently*^- 
in demand' because of the general shortage of bilingual teachers 
that thdy didn't have to work under these trying conditions, 
and woul£ hot unless paid real bonus wages which made the * * 
% * entire effort unfeasible' in terms of cost. Adult*. members of 



children's own families were willing to endure the hardships 
of €he migration*, ^and their concern for the children's educa- 
tion stemmed from their own experiences t trying to. acquire an 4 
Education despite constant moving*.* This made them caring 
teachers, and" with training most became «very skillful ^teachers. 

Sinqe these adult 'bilingual paraprofessionals had, -limited 
academic background * (high school or G.E.D. at best) , and no 
previous experience in teaching, they needed intensive and* 

very focused training to enable th£m to .quickly "acquire the 

* # 
skills of teaching. . 1 , . • 
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It should net be noted that since IBI became part; of the 

* national diffusion network/ a number of other school districts 

.have adopted parts of the IBI program, (curriculum and 'training)'. 

These districts are using -.the usual 6ombinati'ons of professiQnal 

teachers and aides, and the training has been very much praised 

py the certified staff who have taken it. In other words, 'it • 

is specific and thorough enough to use with an untrained parent 

or aide/ but the professional staff have found it equally 

useful. f 

THE TRAINING PROCESS: All of the training units were developed by 
the* IBI program, and 'have by now been extensively' field tested 
, and revised irepeatedly. There" are usually two to three for 
each curriculum area, plus general classroom management 
training. There is one ' "orientation" unit which hits the 
highlights of all th6 others and enables the new IBI teacher' 
to begin teaching immediately wi£h the "fine points" of teaching 
% coming later through the in-se*vice training in each area. 

(In some short term migrant centers which Jiave adopted 
the ,IBI program, "this orientation unit has been useful because 
these programs do not last long-enough for the full 'training 
prqgiram. The orientation unit section highlights "the most 
important skills and the- adoption, sites have used the sections/ 
that go with whichever curriculum components they have\adppted. 
IBI considers thi£, 4 an "adaptation" rather than an adoption? ' • 
however- careful monitoring of results in the first Such site 
indicate the training and* curriculum were effective even in ' 
this "quick and. dirty"'*version. ) < 
>Each training unit begins with (demonstration. ^Imitation 
was found* to be the most time effective way for teachers to 
acquire teaching techniques*; ) The discussion guides^ that * go 
* . with the demonstration are programmed wittf "feedback questions 
designed to check the -understanding of the participants. A 
Trainer's Guide for each unit give5._£uggestions oh how tq^ 
demonstrate, and the answers to the feedback questions in 
the discussion guides used by the trainees/" 

(At other sites which have adopted the IBI curriculum and 
training, the initial training with demonstration is given at 



* 62 

the adoption site by IBI staff,. Subsequently IBI trains 
someone at the local -site in how to take over *this phase - ^ 
of the training for .purpose of training replacement personnel. V 
The second phase' of the training is completion of class- * 
. room observation form's recording how the teacher trainees 
actually performed the teaching techniques. Ffeed^ck is % * 

, given after observation. Usually two to three observations • P 
5>er teachet are required bejore all teaching skills can be 
consistently demonstrated. * At that point a checklist is ' * 
filled out listing the skills the teacher is able to Remonstrate. 

•The checklist states the criteria for considering the training 
to be passed. ' * 

- ■ •■ , • ... ? 

FINDINGS: IBI set as a standard that the 'teachers should be able' 

to complete and pass one training -unit ^eVery tw6 months (based - 
on -available trainer time, arid taking into Recount, the time 
needed to practice skills in between the observations*) T^This ' 
goal was met at one Washington state site (5/6 teacfrers. cdmplette'd 
this much training) . ' At the Texafe site, which includes the 

^ v • mobile component, 10/13 teachers met the training schedule. 

At the other Washington .state site none (0/8) of the teacher's 
coiripletdd the number of training units needed to meet. the \ 
project goal. Fortunately this site had a numbe'r of experienced 
staff carried, over f rom earlier years so that the lack of new •' 
training in the. current .ye&r, has not daeen; as critical* to tffe "• 
operation of the , center as it, Would ^iave been with" eat i rely ' »• 
•new staff. This* project goal- was considered to* b'e' "partially \ 
met.". "•'*••*.. - 

GOAL 2.2.- -STAFF WILL CONTINUE ACADEKTC TRAINING. . 

% « * H 

THE NEED: , The bilingual -adults' hired o as teachers for the'lBI program 
usually have at most a high school eSucai:\on: ; ' About, one/third > 
have less than a high school or G.E.D. background 'when employed. 
As many prove to be gifted .teachers the project has attempted 
to provide an" opportunity for continued academic work at the * 
college level which could lead to full professional status - 

4L, a. * - A 



ACADEMIC TRAINING PROCESS: ' The project manager and educational 

director h'ave shared responsibility for obtaining arranqe- ' 

ments with agencies* offering G.E.D. courses, or 'colleges in 

the area of IBI sites, offering extension typei classes that , • 



can be taken to the area where 
the past^ Columbia Basin Collegi 



the programs are offered. In 
approved the course content 



presented by IBI and approved ttte instructors .for 'the courses 
{IBI staff members), and issued cretTita-^ Under this program 
several staff members received, their one year certifipates 
and some came close to the two year degree status. In Texas 
. a project bus took several staff members on an 80-mile round ' 
^ trip to take college extension courses. The colleges cooperated 
by changing the time schedules to allow teachers. to complete 
the courses before the time of the annual migration north, 

FINDINGS: The academic continuation program 'was not implemented 
in the last program year. Negotiations for a' new academic 
program have been carried out,. and sane Washington state staff 
» have attended a program under Title I sponsorship for college 
courses. Some G.E.D. classes were held- at the Washington 
^*:'st>a*e sites. This effort has been considerably short of the 
: ^-p.roject goal that 80% of full-time staff could participate in. " 
such continued training, and the goal is therefore reported 
' as "partially jnet. ,f - * * ' 

GOAL' 2.3. TRAINING STAFF WILL RECEIVE "TRAINING. 

* e 

THE ItfEE'D:^ The IBI training materials and methods require., specific 
orientation of training staff to develop necessary background 
and skills. t» * - 

TRAINING * APPROACH : IBI^hfas developed two draining units to prient 
a new trainer to the project curri durum apd training mate^SIs , 
and to develop skills in -demonstration, observing, and^con- ~ 
ferencjng trainees.. v It has" developed one moni t or i nc^uni t 
which is used to review the knowledge Wd training skillsi of 
-. an experienced twiner tb see if they are,. adequate in 4 all 
< curriculum areas. / . ^ 



The first *trainer unit is a. background unit to evaluate * 
* the trainer's knowledge of the rationale and content of all 
of the curriculum and training materials, and is evaluated 
with a quiz. The second training unit and the monitoring ,N 
unit are performance instruments evaluating the trainer's 
ability to demonstrate teaching techniques, take observations 
(obtaining inter-observer reliability) , and do effective con- 
ferencing. Each has a, criterion performance level" specified ' 
. in the instrument. 

FINDINGS: IBI had only one new trainer hired during the 1977-78 
program. The, trainer training units were carried out with 
this trainer. However, for reasons of health the trainer 
resigned before completion of the trainer training process; 
A replacement had not yet been hired at the end of the program 

year. ' 4 

* * 

The ^experienced trainers were monitored. Reliability 
on the training instruments was obtained, with all trainers 
one" or more times during the year. Because the one new trainer 
did not .pass, the trainer units within thfe six month ppriod 
specified in the project goal, this goal is reported "partially 
met. " ./ f 

PROCESS GOAL 2.4. STAFF PROVIDE APPROPRIATE TRAINING OPPORTUNITIES'.* 

THE NEED: To meet the project's training goals , the resource , 

trainers (and staff trainers must provide in-service training 
throughout the year, and the Project Manager or Educational 
f Director arrange college and G.E.D. opportunities. 

PROCESS: The IBI resource trainers are responsible for developing 

training materials and orienting staff trainers in their 

usage. The trainers are required to provide in-service 

training and "monitoring , and in the past have prgvided course 

work leading to academic credits. The Project Manager, 

A assisted by the 4 Educational Director and on-site staff, 

, arranges G.E.D. courses and handles arrangements and paper 
***** * / 

work for college courses and credits. 
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FINDINGS: The. resource trainers had a prolific year in revision 
ancL development of neede'd training materials — partly in res- 

^ ponse 'to the need to have these materialss/ 1 (dissemination 

ready"* for the use of other^ school districts wanting to adopt 
parts of the IBI program for local use. # The resource 

*" trainers also carried out interna*! project responsibilities 
for training of the new trainer and monitoring the skills 
of the— Experienced trainers** The trainers at two sites 
carried out the full program. o*f in-service training. At the 
other site„seven of the eight teachers received in-service 
training, but the schedule of training activities was les*s 

' ' than the project, g</al. The project manager was unable to 
arrange the academic training opportunities at the college 
level, 'but assisted ip working out cooperation with another 
program" for some staff ' to take college work, and, helped set 
up G.E.D. training opportunities for staff that needed it. 
Thrs-goal'is therefore reported to have been "partially met. 11 



PARENT AND COMMUNITY INVOLVEMENT COMPONENT 

« 

GOAL 3.1. FAMILIES AND .COMMUNITY MEMBERS PARTICIPATE IN PROGRAM 
MANAGEMENT . 

f % v J, 

THE NEED: *In qrdex to maintain program operations to best meet 

the needs of the participants, and integrate the resources of 
• the community, families and community members need to be 
involved in program decision making. 

THE INVOLVEMENT PROCESS:. There 'is an organized* parent/community 

advisory group at each of the three IBI„ sites. v 

In Conn£ll and- Moses Lake, Washington, all the parents 

of children enrolled in the program" are, members • They, in 

turn, elect officer^ as well as official representatives of 

the community. . Eaph group has written bylaws and meets * '* 

approximately monthly throughout the year. 

. In Texas the parents 1 group chose .to incorporate, . 

* • ■* 

. - Instead of officers they 'elejzt a five-member board made up 

' of parents and members *Qf \fthe. community., with the project 

educational director serving 'as its executive officer. s Their 

"purpose in incorporating as , the; "La'Grulla Migrant Coop" was 

to have a group which could legally apply for grant funds. 

for related programs. During the mobile phase when La .Grulla 

* residents have mostly all , moved north to various locations 
doing seasonal farm work, .if official business needs to be 
taken up, the educational director and/or site coordinator 
for the Texas site contacts board members by telephone qnd ' 
business JLs conducted, in this manner. 

In addition to the five-member board, however, the Texas 
site holds general meetings of parents in- order /to discuss 

* center operations 9 proposals , etc. ^During the northern phase 
when mobile centers are operating at temporary sites the 
site-^coordinator may hold'a series of meetings at* the labor ... 
cam£s or at the centers where IBI children are served. 

In order for parents to have information on the project 
fronf which to make decisions all staff report to the parent , 

• '• r - _ 7s ... 
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groups. Each published evaluation is submitted to parent/ 
community advisory groups for review. The trainer and some 
teachers as .well a& the site co<prdinator usually attend all - * 
meetings to report on how the program is doing. Usually 
once or twice during the year some teachers will do' a curri- 
culum demonstration for the parents, and sometimes videotaped 
lessons are shown. The project manager is responsible for f 
submitting outlines of plans that would go into proposals for 
advisory, group discussion and review prior to submission of 
any funding proposal. . * 

Parents in the IBI program have more than an advisory 
relationship to the program. A personnel committee of parents 
and staff screens and recommends teachers, cooks, and other 
support personnel to be hired. 'Although the board of the 
administering school district has the final authority on 
hiring, the personnel recommendations have always been honored 
so that in fact the parent committee has a primary role in 
hiring. The parent groups are able to earn rather substantial 
funds (several thousand dollars over the years) through voucher 
payment for* volunteer services , .and have sole authority over 
use of parents' funds. Parent groups discuss and 7 approve 
proposals for funding. The different sites* have embarked on 
a "number of projects for benefit of members. 

FINDINGS: The Connell and Moses Lake, Washington sites held monthly 
meetings* throughout the year, except for the summer months of 
July and August. Connell held a nuiftber of extra meetings 
during the Spring months *bf 1978 because parents were involved 
in making decisions about the grounds around their new pre- 
school center, and planning for money raising events with which 
to buy a fence. ' (Jtulla Texas held four parent meetings during 
the winter hom e bas e , p e r i od/ a nd four- meetings during the 
migration period. As usual in the * north it was necessary to 
hold separate meetings at different labor camps in order for 
parents to attend. '* , 1 

The following content analysis indicates that parents . 
were active in decision making at each site in at least four . 
'of the five policy making areas specified in the project goal. 

9 . 73 
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* TABLE 1 

CONTENT ANALYSIS OF ADVISORY COMMITTEE MINUTES 



(a) Organization matters (voting 'for officers, meeting time, 
parent group activities; etc.) 



MOSES .LAKE : 3/78 Elect 
officers. 10/77 Plan 
Thanksgiving and Christ- 
mas programs. 7/78 Plan 
for taking children to 
fair. 



CONNELL: 2/78 Disc, 
replacement, of vice 
president . 11/77 
Plan' for Christmas 
fiesta. 11/77 Plan 
for parents 1 time/ . 
use of pickups, etc. 
to move to new center, 



TEXAS: 10/77 (Grulla) 
Report on replacement 
of Board member. 4/78 
(Basin City, WA) Dis- 
cuss helping members 
utilize cliriic, employ- 
merit offices. 



ERLC 



(b) Review proposals 

MOSES LAKE: 10/77 Dis- 
cuss and approve Title 
VII proposal. 3/78^ 
Discuss and approve 
URRD prop. 



• (c) Personnal actions 

MOSES LAKE: No screening 
during program year. - 
Site had held screening - 
in 6/77 and accepted 
candidates for current 
and future vacancies-. 
Staff was hired from 
this list. 



CONNELL: 10/77 Dis- TEXAS: 10/77 Discuss 
cuss and approve Title and approve Title VII 
VII proposal (Spanish proposal, 
and English) . 3/78 
Discuss and approve 

URRD proposal. « 



CONNELL:, 9/71 Screen 
candidates for cook 
position, hire one. 



TEXAS: (at Grulla) 
9/77 Three trainees 
selected. 



<d) 



Discuss plans to ^obtain funds, or' use' parent funds 



MOSES LAKE; 6/78 Agree , 
co use of funds for 
security" windows , toys , 
sheets, blankets, aprons 
for children. 11/77 
Plan for Christmas gifts 
to be bought. 



CONNELL: 4/78 Plans 
for raising money for 
fence and landscaping s 
5/78 Committees .for 
dinner, money^ for 
fence. 6/25 Discuss 
parent donations for 
fund. 



TEXAS: Xat Grulla) 
10/77 Discuss using 
parent funds^for 
building . 



■(e) Discussion of educational program and evaluation of progress 



•MOSES LAKE: 12/77 Dis- 
cuss annual evaluation 
report, parent group 
president to' respond 'in 
writing to, e valuator . . 
3/77 Plan which parents 
will participate' in- 
annual evaluation visits. 



CONNELL: 12/77 Dis- TEXAS : (at Basin City) 
cuss annual evaluation, 4/78 Change morning 
president to respond, opening time to 4 a.m. 

5/78 (at Eltopia Camp) 
discuss tinje 'of bus 
service to k program. 
6/78 (at Basin City) 
* discuss possibility of 
mobile center going to 
Oroville when fantiljtes 
move . 



6/78 Parents visit 
centers, submit eva- 
luations . 



GOAL 3.2. PARENTS PARTICIPATE IN PROGRAM EVALUATION^. 

€ 

THE NEED: In order for the progr.am to remain responsive to the 

needs of the 'families it serves , parents need to have infor- 
mation about the program and provide feedback evaluation and 
% suggestions to program s'taff. 

THE INVOLVEMENT PROCESS: Parents are involved two Ways in program 
evaluation. The published evaluations are "sent* to the chair- 
( man of each parent group snd these are discusse.d at parent 
meetings . % 

During the year at each site a committee of parents is 
fchosen to visit the program and receive an on-site report 
on progress and observe operations. ' After this visit each 
parent completes a written evaluation of the different curri-" 
culum areas being taught, making suggestions for .change or 
>> giving apprgval. At Grulla, a team of experienced teachers 

- make home visits to talk about the program and to invite 
¥ parents individually to visit the program. ' During their 
visit the same team of teachers 'explains the program and 
parents are asked to take part in the activities of their 
child or children. At the end of the center visit the parent 
fills out the written -evaluation form. Some parents who do 
not feel comfortable writing their comments gave oral evalua- 
tions on the different paints to the teachers. who wrote thes<e 
comments for them on the evaluation form. * 

This method of soliciting parent evaluation was developed 
so that the parents would have, specific information about the 
» program in orde£, to evaluate it. It was felt that in this 

& way more spec/ific suggestions would-be made on all aspects 

of the program than would be obtained by asking for evaluation 
comments . at a general parent meeting* ^ 

* v 

* IT i 

FINDINGS: , The evaluator received writ-ten parent evaluations from 
parents at all sites. Some parents added personal letters 
primarily to praise parts of the program they felt were par- 
ticularly helpful .to their children. There were almost no 
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suggestions for program change to come out of this process 
in the past' year. It does seem to have been effective in 
giving parents a detailed familiarity with the program. The 
presidents of the parent/community advisory groups at the 
two Washington sites provided written responses to the pro- 
gram evaluation. The goal was met at all sites. 
* 

PROCESS GOAL 3.3'. STAFF WILL REPORT TO PARENT/COMMUNITY GROUPS. 

THE NEED: In order for the parent/community advisory bpard to 
patticipate in decision making, staff needs to keep them 
informed about, the program through providing proposals and 
evaluations, and by having staff attend meetings, make reports, 
' and maintain outreach contact in the community* 

> 

PROCESS: On-site staff (administrative, training and teachers) 

regularly attend parent/community advisory board meetings and 
periodically make presentations about various aspects of the 

.program. The site coordinators or other assigned personnel 
contact parents and community members about meetings' and ' 

.program need? and children* s progress. Pri6r to proposal 
writing, a summary of plans highlighting any proposed changes 
is distributed "(in Spanish and English) and discrussed in both 
Spanish and in English at the meetings. Every project^e valua- 
tion is mailed to the chairman of each advisory group. 

FINDINGS: Minutes of parent Meetings indicate that staff members' 
attended each one. There are fj^quent summaries of reports' 
/ that were made about program operations. Letters from the 
chairmen' of parent groups dopument receipt and approval of 
project evaluation. In the judgment of the e valuator, there 
was- a substantial effort made- at every- site to involve the 
parents and to obtain community participation in the project 
operation and management.. This goal is considered met. 



MAJERfALS DEVELOPMENT COMPONENT 

» 

, GOAL 4.1: STAFF WILL DEVELOP TRAINING tJNITS FOR SPANISH ^READING 
CURRICULUM. • . 

. ' \ N 

THE NEED: The. IBI project has found that in order to adapt puQ 
lished curriculum materials for use by paraprofessional staff 
that €he procedures for presentation which are contained in 
teachers' manuals need to be simplified and demonstrated 
through curriculum specific training units.. As -the project 
'* was 'introducing its Spanish reading curriculum in the 1977-78 
^ program year, the appropriate training instruments for. .these 
• materials neetted to be developed. 

PROCESS: The Resource trainer,draf ts ' the training unit as a four- 
part unit: (1) training and discussion guide used in initial 
presentation; (2) Trainer's guide on how to demonstrate the 
teaching techniques, and keys to answers to the feedback ques- 
tions included inthe discussion guide; (3) observation instru- 
ment; and (4) checklist with' criteria for passage of the 
training. These materials must provide the teacher with under 
standing 'of the concepts\to be presented and demonstrate 
Useful teaching techniques for presenting lessons to children. 
The materials are field tested, at one site by the resource 
trainer, and revised_,if indicated. The resource trainer then 
holds workshops to orient the trainers at all sites in' use of 
the training materials . \ 

\ 

FINDINGS: Because the Spanish reading materials were parallel to 
the reading curriculum in English, the Resource trainer 
revised the reading- training, units drawing examples from 
both Spanish and English materials. The same training, there- 
fore, is 'used for the teaching' of either English or Spanish 
reading. These materials have-been edited and published and 
are dissemination .ready for use by other programs as wejl as 
within the IBI project. - 

• * 



goal 4.2. staff will develop mastery tests geared to spanish" 
reading:' • 



THE NEED: Bepause project children frequently miss school during 
relocation, the project needs curriculum specific testing 
materials to use for placement in the materials and for 
identifying concepts the child may have forgotten in an v 
absence. The tests also help monitor child progress. From 
errors made by the children in the periodic testing, the 
trainer, can detect aspects of the curriculum which the * 
teachers may not be teaching well ax\d provide specific assis 
tance. The Spanish reading curriculum introduced -in the 
19 77-78 program year required the development of a specific 
mastery test to fulfill these functions. v * , 

4 

PROCESS: The staff , assigned to develop the test reviews the 
^ curriculum selecting key concepts or a sampling o# material 
covered. Test items are prepared and assembled into a test 
book which will be used by someone other than the child's 

teacher tp check mastery. -Score sheets and instructions for 

, ' « * * 

* administering the test make up the final test package. 

FINDINGS: Tike Spanish reading achievement test was developed and 
is in use in the IBI program toeing field tested. The goal 
was therefore met* 



78. « 
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THE NEED: The U,' I Office of Education brings out a publication 
6ntltled Mucatioual Programs That Wrk This document lists " 
programs that have been 'found by the Joint Dissemination Review 
. Panel of USOE to have "credible evidence" that they are * 
• successful i n raising the achievement of children they serve 
Programs which meet their criteria are "validated." The 
^ location in which they" are described is distributed widely . ■ 
among educational agencies'in an effort to encburage other : 
. districts to find out more about proven educational practices 

• and a^pt those that fit their cm situation. IBI was validated 
m 19 73, although at that time the project title was "Taining ' 
Migrant Paraprof essionals in the Bilingual' Mini Head Start." 

The project name was changed tb Individualized Bilingual 
instruction (IBI) because USOE felt a shorter, better descrip- 
, tive' title would be helpful to dissemination. 

Because of efforts of USOE to draw attention to its 
validated project, IBI has received many many requests for , 
information on every conceivable facet of the program. This 

• goal was included for the 1977-78 program in an effort to 

. develop materials that would describe the program which could/ 
be sent out in response to such inquiries. 

PROCESS: The project director fqrwarded to the evaluator the file 
of inquiries and these were tabulated to find the types of 
information sought. From this an outline of proposed descrip- 
tive documents were made up and discussed among staff for ' ' 
suggested content. The evaluator was assigned writing 'respond 
sibility with editing help from other staff. . 

< * 

FINDINGS : This goal was greatly -expanded by the project V -approval . 
xn 1977 as a developer/demonstrater, project in the .National 
Diffusion Network, It was necessary to produce a Level r ' 
awareness brochure-describing the program in general terms. 
. Level II awareness materials were also produced,- a series of 
^ brochures describing in some detail the components (various 



curriculum areas) which could be separately adopted by* other 
districts. Because the program was selected as one of 21 
projects which USOE wanted to recommend for special consideration 
by, districts receiving Title I or Title I Migrant Grants, it 
agreed to participate in a aeries of regional conferences 
blanketing the United States , and to present the description 
of the program several times at each conference. This 
necessitated preparation of slides, overhead projector plates, 
*and a descriptive presentation. This presentation was varied, 
$nd was also presented at several state meetings set up by , 
State Facilitators], e.g., agencies with grants -to disseminate 
information about successful educational- practices in their, 
state. The goal was met. / . " 

Also in the interest of dissemination, all of the 
evaluations have been put into the ERIC system, which h&s x ' 
made them available through libraries'. The number of ERIC 
publications about this program are: , ' v • 



ED133133 
ED114222 
ED116868 
ED116871 



ED116870 
ED116876 
ED116866 
ED116869 



ED134374 
ED157642 
ED152464 
ED116875 



ED116874 

ED116873* 

ED116872 



MANAGEMENT COMPONENT ?5 



GOAL 5.1. FOLLOWING CHILDREN AS THEY MOVE. 



THE NEED: "The IBI mobile . component offers a unique i nter state 

■ delivery system. Teachers relocate with the migrant families 
,whp move from one state to another seeking seasonal agricul- 
tural work. With each relocation children reenroll and the 
educational program continues. The. need for such a delivery 
system stems for b^e assumption basic to this ^program that 
an effective effort to keep migrant children from falling 
behind in school must provide services in more than one loea- 
r . tion since migrant children are never able to. receive a full 
school year in any one place. There is a need to monitor v 
how well the project success in following children as they 
move in the \ mig'ranfc streairw 

PROCESS: Anticipated travel patterns of families are checked durin 
tfte winter. Any replacement teachers to staff vacancies 

are recruited from adults of families known to be moving 'to 
an atea where there are .a cluster of children to be se'rved. 
When migration begins/ the site coordinator is responsible 
♦ for finding teaching space ip. temporary locations in the nortji^ 
and for contacting "families who have moved, recruiting the 
children for reenrollment in the program. From the weekly 
- progress reports filed by all teachers the evaluajttfr maintains* 
a "flight .pattern" .on children as they move from site to site.* 

FINDINGS: ^ Eleven teachers -from- Texas relocated to the north and 
' worked with children . followed from Texas. There were an 
average of five children followed- by each teacher. A number 
of other bilinigual migrant children, were temporarily enrolled 
as time and sjpace permitted at each site. This met the project 1 
minimum . goal, but was the project's least successful year in 
following children, from the home base area. 
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GOAL .5.2. COORDINATING WITH EDUCATIONAL AGENCIES IN HOST 
COMMUNITIES * . 

THE NEED: This program is unique in that- it is interdistrict 



, and interstate. In Washington state* the two ye^r ground 
sites serve children dlrawn fi?cm three different school 

• districts^ The mobile component is in one school ^distr-^ct 
in Texas, and operates tempor^§y sites in several other 
school districts in the\northern states to which it moves. 
Coordination with o'ther educational agencies is therefore 
a critical factor to operating it successfully. . s 

PROCESS: Contact is madfe with school officials at each site explaining 
the purpose of the program and its resources, During the 
regular schooL year the home base district in Texas allows 
children released time from their regular classes to go to 

rooms, "also provided by the school, where the IBI teachers 

f « • . • *> 

work with them in small groups for approximately an, hour a 
o . day. When the project moves north cooperating schools^ have ' 
o provided space and released children ^from regular classes to. 
work with the IBI teacher. By contacting th.em before the child- 
ren get to. the school district they have sometimes gone further* 
to be sure that Grulla children are assigned to the same schbol « 
building so that the # IBI teacher can work with them' as a group ' 
instead of going from school to school with'only one or < two 
children per school as^ happened the first year. In several - • 
schobls IBI teachers have been 4 asked to^ teach additional 
children felt by the school district t;o be Ip. special rieed of 
bi^^ngual tutoring, and has accommodated as staff time permitted 
after serving the base group it was following. . At the Washiagton 
state sites-, the sdftoo.ls have permitted children to leatfe early 
in the afternoon to go to the IBI center in which preschool 
children^ were served in order to continue the bilingual progr|$i. 
The time they ^are in'. the program is therefore partly school 
time c*nd partly after school. Kindergarten children are usually * 
served at the preschool, center^n the "other half 'day 11 when . 
, they are not in the 4 school program and are bussed either by the ' 
school or IBI. If special migrant summeWschool programs, are 



being held the children. enroll in these , and again have^ the IBI 
• program as a supplemental program on released time or non 
school time. In some cases the IBI teachers are assigned to. 
work for the program in the school district except for an hour 
or so during: which they are allowed to work with all children 
in that program- that, are enrolled in t.he *IBI curriculum. 

If there' are preschool programs operating at the temporary 
sites, i again IBI children -will usually be enrolled in the local 
program and IBI staff will work . .with' them on a release time 
ba^is. IB y operates' a preschbol ceriter (using Head Start or 
day care- operating funds) at each /of the three year-round 
program sites, 

FINDINGS: This procedure sounds enormously complicated but ha| in 
fact, worked .very smoothly. School districts approached have* 
v all f^lt the program was. valuable arid cooperated with itV The 
side benefits have been* numerous in that it has given exposure 

v ^ to the IBI teaching methods and curriculum at -every- school 
it has touched , and many have asked for workshops, ordered 
materials for use in regular classrooms, etc. The, goal was 
met at every site' during this program year. 



GOAL 5.3. STAFF WILL .OBTAIN MULTIPLE FUNDING SOURCES TO SUPPOR* 
PROGRAM. 

f ... / 

THE NEED: Because the program is operated on an interdinstrict and 
interstate basis, thk ehtijre' cost -must come from grant sources- 
unlike most programs operating within one school district where 
at least, basic operating costs come 'firom a tax base. Other 
funding sources have made possible the operation of pres&hool 
centers, paying building costs, transportation, food, and > 
salaries of most of the\teachers . The bilingual grant has 
then provided cUrriculufo related costs as it does in other 
bilingual programs, e.g., costs of training staff, some 
, additional classroom staff, fepecial curriculum materials, and 
the overhead costs^ of administration and evaluation. 

The task of finding th.e compahion resources to carry out 
this program true to its original concept has been especially 
difficult because of the unique program design — e.g., an 
interstate' program following children, starting, during the 
preschoql years ar$ continuing through the earl]/ grades. This 
is because most state or federal money channeled through states 
is, restricted' to expenditure within the stat^ which granted 

the furid^". Likewise the Head Start and day- care money used 

to pay costs iYi^the preschool program cannot be spent, for 

, school-age children, etc. Despite these obstacles a larcje 
numbej^of* funding sources have v been pulled together to fund 

s *all aspects of tlT§ program in. the. different locations it must' 
oper&t*. It has made IBI also a demonstration project in use* 
^ of "mi/ltiple funding" (a case study was written up on this 
aspect of the program by a^con suiting *firm hired by US'OE) . 

PROCESS: The 'process is essentially .the same as for obtaining the 
bilingual grant; establishing the need and the .potential of 
'the. proposed program to^meet this need, defining a budget , 
within the ^limitations of budgetary autho|ity of the ig^anting 
agfency, and/ subsequently^ evaluating program and use of fields 
tta> demonstrate' that the prograflr is successfully carrying out 
effective education for children as projected in« the project 
. , goals. ' • * 3 , 



.FINDINGS: The cornerstone gre&ft for IBI is from Title VII, 

Bilingual education, USOE. This pays most of the cost of 
• administration and evaluation, training, and curriculum 

development posts, some of th,e costs of curriculum materials, 
used and a. limited number of classroom' personnel • This 
.goal ifas met* inasmuch as project administration obtained 
other sources of .support as follows: 

Washington State Office of Public Instruction; Urban, 
Rural, Racial, and Disadvantaged categorical .funding for' ' 
bilingual education. Used primarily for". costs of the School- 
age program staffing in Washington state. • 1 

Washington State ^Department 6f Human Resources, Title "XX 
day care funding-. Used primarily for the costs of operating'- 
the preschool centers in Washington state. * % < 

Head Start — Indian *and Migrant Progr^n Division /-through 
the Texas Migrant Council. Used primarily for .the costs of 
operating the preschool- denter in Texas. • 

Washington State, Head Start matching state funds. Used 
primarily for the costs associated ^with the' mobile . component 
Head Start children while they are in Washing ton\st ate. 

USOE Develbper/Demonstrater Grant v Uped to pay costs of 
^dissemination of the IBI program. Funds training and staff 
support costs offered to adoption sites, and preparation and 
■distribution, of literature about program, staff td make ' V * 
^-presentations at awareftess sessions, etc. ';• 
Title I' Migrant?) ESEA money channeled through State^f 
Washington. Used for teiqporary facilities at Basin^City for 
£he mobile component children in Washington state .for work 
season, and for the preschool .ceriter at Connelly Also Ifci V 
staff members have contimue^ academic work throucjh^ a staff 
development project administered by -another agency utilizing 
Title I funding., , ' * 

• Bilingual Mini -Schools, a private non-profit agency. 
Paid costs of developing ^the' Language I curriculum *in s'panish' 
for the IBI program, and has assisted in production and 
distribution costs 6f bilingual products developed by IBI 
• . now being sold at cost to other districts adopting the IBI * 
program. v « 



So 

USDA food support. 

CETA personnel at each year-round preschool center. 

ESEA, Handicapped funding; A few children with special 
handicaps are enrolled at the preschool centers in Washington 
state and are supported by handicapped funds. 

In addition the project has utilized -technical support 
provided by a number of agencies: 1 

Both the Bilingual Resource Centers .(University of 
Washington and BETAC at Tacoma) ; TAB and the NETWORK, consulting 
agencies offering services involved in dissemination;^ Of f ice 
of • Superintenderft of Public Instruction Bilingual Section — 
consultation, arid funds to bring interested districts to aware- 
ness sessions* at the IBI site; the Washington State Facilitators 
staff, who have provided assistance in developing materials 
for dissemination and advice on how to carry out the D/D ' 
responsibilities.* ^ , * ' i 



SUMMARY 
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The project's instructional goals were that project/ children, 
after 200 days attendance, would show superiority to thi project 
norm group that was statistically significant at the .05 Vevel or 
.higher. The conclusions as to th^> attainment of the project 
goals for . instruction, and in other areas-are summarized below. ' 
TABLE 2. STATUS OF PROJECT GOALS . *' 



INSTRUCTION ' ' 
1.1 Preschool Concepts* 
•1.2 Handwriting^ 
1-. 3- Learning Spanish. 



1.4 
1.5 
1.6 
1.7 

1.8 
1.9 



Learning English. 
Math. 

Readi^*iri English. 
Reading in Spanish. 



Cultural Concepts. 
Continuity exceed comparison 
children, math and reading. 



PROCESS GOALS \ 

1.10 Maintain appropriate schedules. 

1.11 Use of approved curriculum. 

1.12 Use of approved teaching methods.. 

e 

* * * * * 

STAFF DEVELOPMENT . ( 

2.1 In-service, Training schedule maintained. 



2.2 Continue Academic "Training. 

2.3 ^ Trainers trained. 

» ' < 

PROCESS GOALS 

2.4 Staff provide -appropriate. training 

opportunities . 

PARENT AND COMMUNITY INVOLVEMENT COMPONENT 
3.T Advisory groups do' decision ntaking., 
3.2 Advisory groups take part in evaluation,. 

PROCESS GOALS . . . . * 

3-.~3 SFaff-repo-rts— to^dvis^y^jgr^ups^ 

MATERIALS' D^LOPMENT COMPONENT' 
4>1 . Training for Spanish reading progr 

##: developed. * 
4:2 Mattery test for Spanish reading de 
4.3' Vt)is*etaina*tion materials developed. 



Goal met. 
Goal met. 
Goal met/ except 

at age six. 
Goal met. 
Goal met. 
Goal met. 
Not enough data 

for analysis, yet. 
Goal met. 

Goal met/ 



Met/ but documentation 

partly lacking. 
Goal met. . ■ 

Goal met;. . ♦ 



*Qoal met at two sites, 
partially met at 
third. 

Goal partially met. 

Goal partially met. 



Goal* partially faet. 



Goal met. 
Goal met. 



Goal met. 




ped. 



Goal met.' 

Goal met. 
Goal met. 



TABLE 2. (continued) • 

MANAGEJtENT COMPONENT • 

5.1 Mobile- component tracks children to north. ,Goal met 

5.2 Coordination with other educational Goal met 

agencies . 

5.3 Obtain multiple funding resources. Goal met 



TECHNICAL APPENDIX A 

* # 

The main body of the .final report was written for the general 
reader, and for clarity avoided technical detail. ^Since informa- 
tion on procedures for testing and data collection "and explanatory 
footnotes for the analysis of test scores in the instructional 
component is of importance to a technical reader, that information 
has been reported hera. ~ • 

> 

TESTING AND DATA COLLECTION AND ANALYSIS. PROCEDURES^; 

Training of Testing Personnel 

Independent testers are used at each site — e .g. , , instructional 
6r supervisory staff do not do testing. All testers are parapro- 
fessional bilingual Mexican-Americans.. Sp.nce -more than 95% of the 
chlld^n served are Mexican-American/ this' testing staff has cul- 
tural' ijden£ity for the overwhelming majority of children being 
'tfested. ^ < \ : - 

Each tester is individually trained, on ~ea : cb instrument arid, 
faust demonstrate appropriate procedures *in the testing of at least 
two childreri, under observation, as part of the training. Subse- 
quent monitoring visits review testing procedures annually. Training 
4nd monitoring, of testers is done by 1$je evaluator and/or the 
resource trainer. Experienced testers are, also used to assist i,n ' 
training new testers. ' * 

v _ 

Testing Schedule 

» 

All children are pretested before attending the program for ' 
30 days— iri practice as soon 4s possible after their initial enroll- 
ment. This pretesting includes all bf the instruments used in the 
evaluation appropriate to children bf thfeir age. It also includes 
the project , achievement, tests which are/used to help determine ini- 
tial placement^of children in> project materials. The IBI program 
serves children continuously over the 12 -months of the year. Since 
new children can and do enroll in the program every month dur^g the 
year., pretests are' also given during every month throughout the year. 

Repeat testing on standardized test instruments is* done after 
an individual child has attended for a period of 100 days, i.e., 
the child is tested at 100, 200, 300 > etc., days. Attendance data 
are kept individually for each child and at the end of each month 
a list is made of every child' who that month passed a testing inter- 
val in his attendance. This list is forwarded to the tester at each 
site who> then administers the appropriate tests for that child'. m 
Every month some children at each center reach a testing point in. 
their- pro-am attendance, so post.tests are also given during every 



month throughout the year. Tabie 3 shows the statistics of the 
distribution of testing throughout the year for two of the project 
tests.. The difference in .total number of tests is because the 
PPVT has been in use by the project longer "than the WRAT and more 
^tests have been accumulated. These data indicate that the* testing 
has been fairly evenly distributed throughout the year, and, that 
the time of testing distribution is parallel for the test analysis 
groups utilized. * 



TABLE 3. Distribution Statistics on Month of 

Testing- 





" "Paabody Picture 
Vocabulary Test 






Wide Range 
Achievement Test 




r 


Testf Group 


Number Median Mean 


St. 


Dev. 


Nymber Median Mean 


St. 


Dev; 


* IBI Norm 


" 887' ' 5.80 5.94 


3. 


89 . 


, ! < 

679 * 5.89 5>95 


. 3. 


— » 

90 


200+ days 


694 * 5.94 6.41 < 


3. 


49 


506 5.174*5^94 
V 


3. 


65 
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This, testing schedule is more complicated than the usual evalua- 
tion procedure of doing mass testing at two calendar points. It 
was devised because of the unique requirements of evaluating a mig- 
rant population who have spotty attendance arid who come and go at 
different times during the 'year. When the Texas" Education' Agency 
reports ori child progress between tests administered in October and 
other tests administered in April of the school* year it is not 'un- 
common to have. both pre- and posttests on less than 50% of the 
children enrolled in the" program. Some children are there for pre- 
tests but leave before posttests are given. Other children come top 
late for pretests but are there at the postte?ting dates. Som^ 
children enter- late and le.ave early and aren T t there for eiSTer 
testing point. This is a very common pattern in the evaluation of 
migrant programs — test information presented that represents a very 
unsatisfactory percentage of the project group it is meant to 
evaluate . 

Another problem encountered in. use of calendar date testing 
with a migrant population result^ from their uneven attendance 
patterns. Of two children tested on the same date in April, it 
would not be at all unc6ftmon for one to have attended 50 days total 
prior to that. testing point, another child to have attended 90 days. 
This puts the evaluator in the position of comparing child progress 
between tests, which represent two very different amounts of exposure 
to the program being evaluated* 

By testing based on individual attendance % 'records, each of the 
posttests used in this evaluation represent a known amount of pro- 
ject intervention. At evaluation points the accumulated tests are • 
the© subgrouped by age and the period of attendance at the time of 
testing for purposes of analysis. . * ' 

9'J ■ - ■ 



85 

Selection of Tests 

The IBI program selected the Peabody Picture Vocabulary Test, 
The Cooperative Preschool Inventory, and the Wide Range *Achiq Yemen t ' 
.Test in part because these nationally standardized test instru- 
ments were among those most widely used by USOE in educational 
research and evaluation. The Cooperative Preschool Inventory was 
specifically developed for a measurement of the .effects of Head 
Start programs and was utilized in many evaluative efforts measuring 
the i'mpact of this nation-wide program of preschool education. The 
t>eabody Picture Vocabulary -Test 'similarly has" been, widely used in 
research on preschool programs. .Th^-Wide Range Achievement Test 
was one of two standardized achievement tests 'utilized in the massive 
Follow Through studies. L ' 

. In order to use the tests, however, it was necessary 'to trans- 
late sections into Spanish.' Tests are individually administered in 
the IBI program because of attendance cycle' testing — this affects 
the* math portion of the WRAT which was standardized under group . 
aifainistration .' None of the tests was normed with a group even 
close -Co the IBI composition as- to ethnicity or language use. For 
all of these rea'sons, the basic evaluation .design has been kept 
internal to fehe project. The.Ngoals, are all stated in terms of the 
project norm group, which is matched by ethnicity and language use 
to the project attendance groups. The language and circumstances 
for test administration are held constant in the testing of these 
two groups — indeed the testers are the game. The references, where 
made, to national norms are added so that there is some external 
. interpretive power to the data. But all of these reservations 
about the application of the- national norms restricts* the inter- 
pretation of the data. However r this would be true of any bilin- " 
gual program. 



Analysis Procedures 

.The project norm group is used as a'measure'of the probable 5^ 
achievement level of project childretrvithout benefit of the pro- 
gram. When a 'child enrolls in the program he is pretested. If 
the pretest was given before the chilcf had attended the program 
for as long as 30 days, it is put intoxjie project norm" group for 
children at that acje level. The project has an enrollment policy 
which permits children to. start the program at different* ages , 
e.g., some start when they ar£ three, others, when they are four, 
others at five, or six. By accumulating pretests the project hhs 
been able to d&velop its norm group for all ages on all tests. 
The size of the norm group is increasing constantly as new pretests 
are accumulated. v 

In the past all evaluations have used a nbrm, group obtained ' 
as described in. the previous paragraph* As* of 1977, the norm grpup 
for the Peabody Picture Vocabulary Test and for Wide Range Achieve- 
ment Test was -expanded to include the' tests of children from a * 
neighboring town to La Crull,a , Texas . These children had b'een 
tested for the previous three years to provide <a comparison group 
of mobile^migrant children to compare to the children in just our 



mobile component using the two tests mentioned,, the PPVT and WRA^T.O 
p~*The reason for testing a comparison * group, instead of , just using ** 
» Che project norm group for this special study {see instructional 
goal nine) is that the project norm group includes pretest soores 
on some children |rom permanent side's Who - do not migrate . In the 
special study we wanted .to Hold the ' factor* of migration constant:" 
only project children who migrate^ were tested, only comparison ' - ' 
group children who migrated were tested. . . " \ 

The community where comparison „ group tlests were given and La ' 1 * 
Grulla have . t about the same socioeconomic L^vel — most families earn 
their yearly income from the migration 'period doing seasonal farm 
work. Both communities are Spanish dominant', located on the Rio / 
Grande Rivqr where television stations beam in Spanish language . 
programs, many 'radio stations are in Spanish, the" usual* language 
of casual conversation in town or school woi^Ld be Spanish. As a 
further check on the comparability of the two population groups, 
statistical analysis was done for' two years in a row comparing the 
« nfean test scores by grade level of the comparison group and the 
pretest scores of children at the same level in the project norm 
group:- No significant differences were found. This w$s interpreted 
to' mean that the chi ldren -f*pfo the -neighboring town were, in fac tr 
, the same population, group a's, project childreri and their sc6res are 
like those of, the children pretested for- this program. . • ^ 

Most pretes/t scores for children in this .project w^re.^t lower 
age levels (three, four, five) since the project attempts t'6"*get 
children started as young as possible. Therefore, the addition of.; 
^scores from the comparison' group to the piffojedt norm group enlarged " 
the size of the norm m g roup at "the school ag^ level wh^ere i§ has 
be6n the smallest, paving a -larger norm grobp at these upper ages 

allows .greater stability for*;statistical -analysis. * " 

* * * 

The project evaluation design calls for comparison." of the mean 
scotes'of project Children posttested after- 100 or. 200 'days to 
children in the project jidrm group of thfe. same age. A *t-test of 
statistical significance is run betwee'n the project pQstt.est atten- 
m dance groups^ and the prbj-^ct norm group of the same age. Statis- ^ 
tical ^analysis is only done when subgroups *to be cdtopared have' a 
minimum size of ten* *• * . % /~ * * 

f • 

For this. evaluation all tests' data were put onto computer Icards 
and the t-test analysis 'wafe done using thfe SPSS computer package. , 
The readout using this fconjputer analysis gives tfee *tz-v«alue using 
separate or pooled variances. If a - significant c^f^lrence existed " 
in the two variances the separate 'variance t was reported; if the 
two, variances were riot significantly different the pooled variance 
t was reported in the tables of, detailed project findings, which* * 
follows in this technical appendix., f 

» Most objectives are base'd on comparison of the Ghildrgn with 
over 200 days attendance and the project nojpn group. Because it 
is^ difficult- for a child to accumulate" 200 days of attendance all 
at* the same age level, there is*almost complete independence of - % 
the two groups used in the ana-lysis. - Children with 200 days- at 
age four will *more than- likely* have started the program at age 
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three , for example/"" They will be compared to the pretest scores 

of other project 'children who started the program at lige four. 
* * - * * 

A very small' percentage of the children have both pretest 
and posttest scores at the saifte age level. Analysis was 'therefore* 
done including and excluding this small overlap group. The 
conclusion jvas that any 'bias created -by this, lack of complete 
independence of groups acted against the project ia re.ducing the 
likelihood of a finding of significance.^ 

The test analysis tables report long. term prpgram effect^ 
through .the cumulative analysis, e.gl.r J 'a : U tests through April 19 78 
"Which was *used as the cut-off date for this evaluation. The^ 
current, year program* data would be posttefets given in the peritfd 
sirffce* the last analysis, e.g., a Nay, 1977 through April, 1-978. , The 
cunHilative nopn group is used for tests of significance of diffe~ 
rence 'between means for both long term Cumulative ''and current year 
analysis/groups . The,t-value reported^jPi feach table is between 
the posttest attendance group, and the project nt>rm grt>up o£ th£ 
^same age category. \ . ■ 

To maintain: a high level— of -acettracy -tfl—handling of test data 
the 'following precautions are taken. Each tester scores tests' 
she administers. All -tests are checked and rescored upon receipt.' 
After preparation of the computer- cards a readout is obtained and 
two persons recheck the accuracy before the* decks are used. After 
analysis has been done / the 1 s "of subgroups are rechecked against 
the project d$ta entry records. . / 

The* project has employed independent evaluation specialists 
^who have reexamined all analysis procedures and validated claims. 
The evaluation division of. Northwest Educational Research Labora- 
tories in Portland performed this evaluatibn review and audit , 
through 19*74 and -Technical Assistance Services of Seattle thfough • 
1978. * . 0 . - " . ; 
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STATISTICAL DETAIL OP TEST ANALYSIS FOR "INSTRUCTIONAL COMPONENT 



1.1 PRESCHOOL CONCEPTS 

TABLE 4. Cooperative Preschoo.1 Inventory Test Scores 

Cumulative Analysis 



Age and 
Attendance 



' ♦ « (w/norm) 

Number Mean St. Dev. t- value 



2-taiL Nat'l "' 
prob. Percentile 



AGE '3. .0-3. 11 ' * 

IBI norm * 200 

100 days - 77 . 

200+ days 17 

AGE 4.0-4.11*. 

IBnTorm 126 

100 days 152 

200+ days 160 



10.060; 

24/5.71 

291941 



7. 764 
7. 397 
6.189 



29 .984 10. 836 
34.112 8.444 
39.375 8.832 



36 

,62 



3.49 
7.88 



0.000 
0.000 



0.001 
0.000 



30th 

53r<T" 

69th 



35th 
50 th 
67 th 



AGE 5.0^-5.5 
"IBI norm 

100 days 
-200+ days 



35— --37.400 " S-.-23-3" 
46 . 43.348 10.102 
123 47^260 7.274 



2.72 
6:65 



"Current Year Analysis 



0.008 

o:ooo 



43rd- 
6"6th 
78 th ' 



AGE 3.0-3,11 

"100 days * 13 

.200+ days 4 

Age 4.0-4.11 * 

100 days ' • " 41 * 

200+ days . 33 

AGE .5.0-5.5 "• 

100 days . 12 . 

2b0+ days " 31 % 



25.462 6.83£ • 2/90 
(too few for analysis) 

•\ 

32.000 
38.606 



45.250 
49. 323 



9.187 
7.677V. 



7.362 
6.327 



1.07 
5.23 



2.6& 
6.18 



0.004 



0.285 
0.000, v 



0.011 
0.000 



5 3rd 



'41st 
67 th 



/72 nd 
85th 



NOTES - ON ANALYS-IS : 

Cumulative Analysis includes all .tests 1-973 through '4/78^ 
Current Year Analysis iricludes »tests given between 5/77 and 

' 4/7"8. , " « - . • , 

The' t-val'ue compares ^the means ox" the post test attendance . 

- groups.- -to- the. IBI 'norm group in the cumulative analysis. 
Age 4.0-4.11 perfcefrtiles based" btt "national "norm ->f or 4.6-4.11 

. , age group., / ' / *--.'.*•*♦''' . • 

--*?*.■ • •, . . . ' . - ■ . * 
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TABLE 5. Wide Range Achievement Test, Spelling Subtest 
, * , « • Scores , 



Age' and 
Attendance 

AGE 3-. 0-3 :11 
" 100 days 
- 200+ days 

AGE 4.0-4.11 
IBI Nomi 
100 days 
200+ days 

AGE 5.0-5'. 11 
IB I Norm 
100 days 
200+ days 



AGE 3. 0-3. 11 
100 'days 
200+ -days 

AGE 4.-0=4.11 
"100 days . 
200+ dc^ys 

AGE 5.0-5.11 
100 $ay£- • 
200+ days' 



Cumulative. Analysis 



Number Mean St. -Dev. -t-value 



183 
74 
12 



134 
155 
128 



102 
95 
'176 



'12 
4 



39 

,33 



17 
57 



.0.853 
' 2.56 8 
4. 417 



2.963 
5.929 
0.134 



7:529 
11.368 
15.097 



1.320 
1.902 
2.906 



2.880 
-4.. 0 82 
5.134 



4.516 
5.155 
'4.191 



7.10 
4.22 



7.21 
12*. 12 



5.57 
14.10 



Current Year Analysis 



2..167 " 1.642 3.29 
(too few fcr analysis) 



5. 436 
9.091 



13. 0 5-9-- 
14 . "5 60 • 



4.291 
5.615 



'5.250 
4'. 20-6 



•3.38 
' 6.08 



4.57 
7.28 



2^tail 
prob. 



0*000 
O'.OOl 



0.000 
0,000 



0 .000 
0.000 



0.004 



0 .001 
0.000 



0.001 
0.000 



NOTES ON ANALYSIS: ' "" ' , 

Cumulative Analysis includes 'arf tests ,19 ?3/ through 4/„78. 
Current Year Analysis includes all tests giVen 5/7T 5 throuqh 
* 5/78. • • J _ 

'The t-value compares the means of the posttest attendance" * 
group to the IBI norm group in the cumulative analysis. . 



1.3 SPANISH VOCABULARY ' ' 

TABLE 6. Peabody Picture Vocabulary Test Scores, Form B 

in Spanish ' 

Children Whose Primary Language* is^Spanish 



9J0 



A£je and 
Attendance 
AGE 3.0-3.11 
IBI norm' 
100 days 
200+ days 



Number 

■m 

22.1 
. 81 
15 • 



Mean 

19.950 
26 .000 
28.267 



St.- Dev. 

8.337 
8.S6 8 
6 .984 



t- value* 



5.52 
"4.39 



2-tail 
prob . 



a. ooo 

0.0 e 01 



AGE 4.6-4.11 
IBI - norm 
10 0 jja ys 
20(Tr" lays 



AGE 5.0-5.11' 

IBI norm 
^100. days 
"200+ days 

AGE 6.0-6.11 
IBI norm 
100 days 
200+ days 




28.402 
31.214 
34.090 



8.^54 
9:023 
8.075 



,•66 

28 
108 , 



36.735 
40.6 32 
40 .910 



46 .743 
43.393 
46i , 639 



9.390 
9.005 
7.78 

10 . 16 4 ■ 
9/00 5 
> 8.111 




2.60 
5 . 44 



2.76' 
3.75 



rl.47 
-0.07' 



0.10 
0.00 



0.00*6 
0.000 



0.145 



0.944 



/f efrildren Wh6sfc Primary a Language is English 

6 v - «. , 



AGE 3i0-3.fi 
IBI .norm* , 
100 days 
200+ days 

1 AGE 4*0-4. 11 
IBI norm . 
100 days , " ' 
200+ days, ^ 

5.0-5'. 11 
IBI norm 
100 days 
200+ days 



AGE ( 6.0-6.11' 
IBI* norm k 
100 days / 
200+ days^- 



54 

'30 
5 



6-1 
43 
44 



-26 
33 
62 



13 

II" 
27. 



,' if. 091 6 . 331 

-10.000 I 6.486 2.69 
(.too few foi Analysis) 



, .8.148 
. lV.279 
14.659 

I: ' 

11: 885 
• 14.970 
18\9 84 



17V0-77. 
25; 000 
24.482. 



la. 076 
il.724 
9 . 829. 



11.687 
14'. 66 8 
12.517 



17. 380 
18. 836 
'16.-568 



% 2.86 

'3. 30 



0.88 
2.^47 



1»j07- 
1 .. 30 



-OVOO? 



0.00:5 
0.001 



0..385 
.0.015 



0.296 
0.200 



*The - t-*va*lue compares the means of the posttest attendance 

groups to the project norm group of- the .same age and language 
' -classification. \, ' • ./ ■ 



Jr. 4 ENGLISH VOCABULARY 
TABLE '' 7. 
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. " /■ 

PEABODY PICTURE" VOCABULARY TEST SCORES IN ENGLISH, 
• . FORM A - - - 



- AGE 3.0^.11 
' 100 day,s ' 

AGE 4.0-4.' U 

• LOO days^ 1 • 
.20 0+ days 

AGE 5.."0-5-ll 
100 days 
20Q+>days 



Cumulative Analysis 

. • 
Test Group:- Children Whose Primary Language 
'is Spanish 

a- tail 
t-value prob s . t 



Age and 
Attendance 


Number 


Mean .. 


6 

St.. Dev. 


IBI norm 
10 0 days 
200+ d^ys 


• 

22J 
62 


6.448, 

10.866 
16,. 26 7 


4.2J 1 
6 478 • 
8.598 


IBI norm - 
• 1O0 days . 
200+ "days 


132 ■ 
' 145 

' ' 134 


9.-879t> 

• 14,255 • 
_ 20.4-25 


7ri:g5 
- 8 . 075 


IBI norm 
100 days 
2O0+ days 


?8 
76 

178 


12.398 - 

20. 145 
• 27.292 


:s.sbs 

13.-637 . 
15. -2 so- 


Apr /■ . a a it 

IBI norm 
100 days 
20Q+.days 


6G *• 
28 
108- 


• 

17". 682 • 
28. (TOO N 
• • 37.583 . 


il'. 911 
14.684 
15.351' 

ft 


AGE 7 $0-7. 11 
IBI norm 
100 days , 
200+ days 


G7 
6 

• 52 ' 


£7.89*6 
33.333 . 
42. 885 


J5.818 ' 
20.520 
. 12.502 


' t AGE g. 0-&. U 

IBI norm 
. ' J0D days 
. N 200+ days.'. 


' '46 

37 


''133.261 
44-333 

sr. 08.1 


,16.686 
.11.590 
.9.722 



5.. 74 
4. 39 



4.75 
8*. 49 



4.21 
9.95 



'3.58' 
9.5* 



0.000 
0.001 



0.000 
p. 000 " 



0.000 

0.000 



0.001 

0.000 

> 



(too few for analysis) 

5.61' 0.000 



(too few for analyses)' 

• 7.44 0.000 



.10 



28 ^ • 



Current Year. Anal y si &* 



13.700 8.908 " . Z.56 



13 
42 



12.657 
21.500 



•'2-3.615 
2.6 . 310 



5.841 

14.688. 



1.4-385 
15.371 



2.U 

4. 08 



2.73 
5.43 



0.0-31 



0.036 
O'.OOO 



0.017" 
0.000 



TABLE 7. (continued) . • 

15 . 40'.447 14.845 



AGE 6.0-6.11 
'200+ days 



6.52 



AGE 7.0-7.11 
200+ days 

AGE 8.0-8.11 
200+ days 



20 



15 



43.400^ 13.10Ot y.73 
58.467 10.246 6.98 



*Too few for current year analysis in 200+ days at 
and 100 day groups at ages €, 7,, and 8. 
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• 1.5 MATH" SKILLS 

. , TABLE 8. WIDE RANGE ACHIEVEMENT TEST, MATH SUBTEST SCORES, 
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• Age and 
Attendance 

AGE 3 ' 
IBI- norm 
100 days . , 
200+days 

AGE 4"..^^" 
IBI- norm 
""10 0 days 
200+ days. 

AGE 5 
IBI norm 
100 days- 
200+ days 

AGE 6, 
IBI norm 
100 days 
200+ days ^ 

.AGE 7 * 
IBI norm 
100 days 
200+ days 

AGE 8 
IBI norm 
100 days 
200+ days 



AGE 3. 
100 days 
. °200+ days 

AGE 4 
100 days 
2JW+ da^s 

AGE 5 * 
100 days 
200+ days 

AGE 6 • . 
100 day.s ' 
200+ day& 



Cumulative Analysis 



Number 



183 
74 
12 



134. 

155 

128 



Mean Nat'l 
St. Score %ile 



Raw Sc. 
Mean St/. Dev. 



102 
95 
176' 



74 
44 
92 



.52 
*10 
33 



3$ 
-33 



17 
57 



2.929 2.046 
5.851 2/713 
7i250 3.361 



80.461 
'94.674 
104.591 



86:811 
96.591 
107.348 



9 th 
37th 
6 3rd 



- 4.754 
8.439 
10.422 



8.80'4 
12.295 
14.972 



79 . 86.9'24 
24 20.167 
51 M01.275 



87.615 
90.800 
97.152 



19th 13.446 
42nd 16.500 
68th 19.250 



19th 19.127 

30th 20.167 

53rd 24.412 
y 

19th 22.-981 

27th 24:300 

42hd 27.242' 



4.115 
4.368 
3.779 



4. 852 
5.028 
4.510 



4.876 
5.079 
3.093 



4.676 
2.263, 
1.921 



Current Xear Analysis 



12 — ' • — '5. 751 2 .221 

■4 (tgo few for 'analysis') ' • 



. 94.824 
101.597 



,10 82.400 
27 W03. 852 



7.103 . 3.299 
~ 10.394 3.316 



37th 12.235 ' 4 3. 898 
53rd ,14.211 3.406 



12th 11.800 -5.996 
58th 18.074 • 4.178 



t-value 



8.35 
4.40 



2.895 ' 
3.754 "9.41 
3.456 . '14.36 



5..78 
12.69 



3.26 
7.97 



0.91 
7.56 



1.37 
5.84 



4.60 



4.32 
9.73 



3.21 
'8.43 



-0.98* 
4 V39 



2-tail 
prob. 



0.000 
O.OOli 



0.000 
0.000 



0.000 
0.600 



0..001 
0.000 



0.367 
0.000 



0.183 
O.00O 



O.OO'O 



0.000 
0.000 



0.002 
0.0Q0 



0.330 
0.000 
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TABI^E' 8/- < continued) 



5-'. ; . (too few for analysis) 
18 '102.833 <58th. 25.000 1.910 



7 

AGE 7 - " 
100 days5 
200+ days 

AGE' 8 ; ' • 

1007 days 0 > 

20Q+'days 18 97.'889, - 45th 27,. 5*56 . 2.064 

I 



5.01 



5.64 



94 



0.000 



0.000 



\ loo 



>. 



? 
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1.6 READING IN ENGLISH 



TABLE, ?. WIDE RANGE ACHIEVEMENT TEST SCORES, 

Cumulative Analv^i q 
CHILDREN WHOSE PRIMARY LANGUAGE IS SPANISH 
A 9 e and Stand. Nat'l Mean Raw 

Attendance Number Score %ile Score ■ St. Dev . 

A£E 4 

IBI norm 84 

100 days 123 

200+ days 94 



6 .J 86 
8.626 
10.564 



AGE 5 
IBI norm 
- 100 datys 
200+ days 

AGE 6 
IBI norm 
100 days . 
-2^00+ days 

AGE 7 
IBI norm 
100 days 
200+ days 

AGE 8 ~~ — 
IBI norm 
100 days ' 
200+ days- 



75 
71 
126 



62 
33 
77 



66 . 

15 

43 



'79.080 8th 
84.225 L4th 
■95.437 37th 



80.145 9th 
,83.667 14th 
95.221 37th 



9.200 
-11.113 
16.405 



14.258 

16". 242- 
-23.610 



79.212 8th 23.439 
-36,86s?- 19th 27.933 
96.767 42rid 38.884 



4.084 
3.463 
3.840 

7 

3.792 
4.982 
7.09.6 



6. 763 
7.429 
10.219 



10.043 
15.434 
14 .'394 



45 
6 
30 



11.871 



79.822 9th -31.111 
(too few for analysis) 
99.400 47th 50.733. 10.859 



CHILDREN WHOSE PRIMARY LANGUAGE IS ENGLISH 



AGE 4 
IBI norm 
100 days 
200+ days 

AGE 5 
IBI norm 
100 days 
200+ 'days 

AGE 6* 
IBI norm 
100 days 
200+ days 

AGE 7 
IBI norm 
100 days 
200+ days 



34 
32 
34 



19 
24 
49 



8 
11 
15- 



11 
9 
8 



87.316 19th 
96.375 39th 
97.633 42nd 



7.765 
9.563 
11. 382 



12.5 79 
16.250 
17.571 




6./354 
5/795 
i.110 



(too few for analysis') . * 
92.273*- 30th 22,455 / 8:858 
102.467 55th 27.46 7/ - 8.927 

-90\545 27th ••35.091 . 13.389 
(too few for analysis) • 
ftoo few for analysis) 



READING SUBTEST 



' - , 2-tail 
t-value prob. 



3.49 0.001 
6'.36 O.000 



2.60 
9.37 



1.32 
6>.46 



1.08 
6.13 



2.01 
3.26 



1.98 
2.99 



0.010 
0.000 



0M9.2 
0.000 



0.297 
0.000 



7.25- O.O'OO 



0.049 
0.00'2 



0.055 
p. 004 



(no norm i group*) "' 
(no norm' group) 



9 



•/ 

* * 

■ / - • ^ 

TABLE 9, (Continued) 
PRIMARY LANGUAGE SPANISH 



96. 



Current Year Analysis 



< 1 ' 
AGE 4 • 

(200 + ) 26 — - — , " 9.539 2.996' 3.18 *O.O02 

AGE 5 . / "* 

(200+) 44 9'2.500 32nd 14.500 5.337 5.79 0.000 

AGE 6 ' t . 

(200+) -' 23 94.304 34th, 2*2. 870 9.593 ' 3.96 0.000 

AGE ' .7 

(200 + ) 14 97.643 45th. ' 39.286 14.398. . 3.92 " 0.001" 

AGE B * . 

(200 + ) '18 ' 103.278 58th^54.111 10.649 7.14 0 ."000 

PRIMARY LANGUAGE ENGLISH < . . 

AGE 5 

'•(200+) 13 96.231 39th 16.846 6.388 1.86 0.072 



* 



Too few for analysis at any other ages 
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1.8 • CULTURAL CONCEPTS 

' TABLE 10. SCORES o» BMrts TEST . OP CULTURAL CONCEPTS 

X 

Cumulative Analysis/ '* 



'Age and 
Attendance 

AGE 3 

!BI norm 
100 days. 
200+ days . 

AGE 4 

!Bi no mi 
100 days 
200+ days 

AGE 5 • 

!BI norm 
100 days 
200+ days * 

AGE 6 and 7 

.IB I norm 
100 days 
200+ days 

AGE 8 and 9 

1BI norm " 
100 days 
200+ days 



Number 



90 
21 
0 



55 
83 
48 



29 
.59 
95 



17 
52 
75 



13 
27 
18 



Mean : 
Raw Score 



17.367 ( 
21. 381 



21.200 
25.639 
26.521 



25.793 
29.40/ 
32.221 



27. .8 82 
34.692 
36.200 



32.077 
37.926 
40.0p0 



Standard 
Deviation 



4.483. 
4.-455 



4.923 
5.554 
4.649 



5.421 



5.518 
'4.659 



7'. 236 
4.869 
4.325 



4.924 
4.506 
2.849- 



t- value 



3.70 



4.81 
5.61 



2.90' 
6.25 



3,62 
4.56 



3.73 
5.21 



2-tai; 
Probabili 



HZ 

0.000 



0.000 
0.000 



0.005 
0.000 



0.002 
0.000 



0.001' 
0.000 



r 
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1.9 LANGUAGE , MATH AND READING SCORES OF CONTINUITY AND COMPARISON 
GROUP CHILDREN: SPECIAL STUDY i 



TAB1.K. 11. 



SPANISH AND ENGLISH SCORES ON PEABOIV/ PICTURE 
VOCABULARY TEST FOR CONTINUITY AN0 COMPARISON 

GROUP t 



Grade Level 
and Test Group 

KINDERGARTEN 
Comparison 
IBI Continuity 



Number 



31 
18 



Spanish 
Raw Score 



40.000 
44.667 



2-tail. T , 
St. Dev. ' t-value ■ Probability 



9 .839 
5.225 



1.70 



0.097 



FIRST GRADE 

Comparison ■* .30 
IBI» Continuity _ 22 



48.667 
50.636 



10.001 
"7.811 



0.77 



0.447 



SECOND GRADE' 
Comparison • 50' 
IBI Continuity . 21 



54.320 
56.714 



10.748 
10.932 



0.85 



0.3^7 



THIRD GRADE 

Comparison " • 40 
IBI Continuity 23 



56.550 
59 .261 



13.651 
10.575 



0/82 



0*415 



English 
Raw -Score 



KINDERGARTEN 
Comparison 
IBI Continuity 

FIRST GRADE 
Comparison 
IBI Continuity 



31 
18 



30 
22 



12.0-32 
22.000 



20.100 
37.000 



7.190 
10.770, 



13.827 
1*3.501 



3.50 
4.40 



0.002 



0 .00 0' 



SECOND GRADE 
Comparison • 50 
IBI Continuity 21 



30.020 
44.000 



16.402 
15.153 



3. 35 



0.001 



THIRD GRADE ' 
Comparison 40 
IBI Continuity 23 



35.875 
56.044 



15.693 
8.177 



6. 70 

... - -i 



0.000 



Spanish* score fro^ Form B, English, Score from Form A of the Peabody ' 

. Picture Vocabulary Test. 
Comparison Group = Children from neighboring south Texas school 

district whose families move during year for 'seasonal f.arm 

work. 

IBl\Continuity = ^Children in IBI mobile component who received edu- ' 
^cational services in Texas artd in one or more ^northern loca- 
tions, and" who were enrolled for a minimum of 200 days in IBI 
program. t » 
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TABLE 12.. WIDE RANGE- ACHIEVEMENT TEST SCORES,' MATH AND READING 
,. SUBTEST, FOR COMPARISON AND CONTINUITY GROUP CHILDREN 

i 

SCORES IN MATH 

Grade~Level * * Mean 

and Mean Stan- Nat'l Raw St. 2-tail 

Tesft Group r Number dard Score %ile Score ' Dev. t-value prob. 

KINDERGARTEN . 

Comparison. 31 76.645 6th 8.548 4.280 5.67 . 0.000 

^BI Continuity 18 103.500 61st 15.833 4-423 

FIRST GRADE 

Comparison . 30 87.933 19th 1*5.000 -3. 869 

IBI Continuity 22 110.545 77th 22.955 3.773 7.40 0.000 

SECOND GRADE »' 

Comparison 50 89.280 23rd 21.700 4.652 

IBI Continuity 21 97.714 45th 24.952 3.057 3.47 0;001 

* 

THIRD GRADE 

Comparison 40 - 8fr.250 18th 24.225 4.117 

IBI Continuity - 23 97.870 45th 28. 391 1.852 5.50 0 .000 



SCORES IN READING 

KINDERGARTEN 

Comparison 31 75.96 7 5th 9.581 4.0 31 

IBI Continuity 18 ' • 89.889 25th 15.889 8.130 3.08 0.005 

FIRST GRADE * 

Comparison p 30 77.267 '6th 18.267 6.313 

IBI Continuity 22 94.136 34th 27.455 10.308 3.70 0.001 

SECOND GRADE 

Comparison 50 78.940, * 8th 2^.160 9.968 

IBI Continuity 21 94.619 37th 40.952 15.114 4.12 0.000 

^THIRD* GRADE • Y 

Comparison 40 77.850 7th 32*300 12.9 80 

IBI Continuity 23 98.348 45th 52.652 9.782 6.52 0.-000- 

Confparison Group = Children from neighboring Texas school district 
whose famij-ieg move during year for seasonal farm work. 

IBI Continuity = Children in IBI mobilfe component who received 
educational septf-cesin Texas and in one-or more northern 
locations, and who. were ' enrolled for a minimum of 200 days, 
in IBI program*, 
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APPENDIX B 



TECHNICAL REPORT ON 'THE 'BILINGUAL MINI HEAD START v 
, TEST OF CULTURAL CONCEPTS 

The BMHS Test of Cultural Concepts was developed in 19 75-76 
to me.et the need of a test of knowledge related to culture that 
was appropriate to children age 3-8.. It, was the finding of the 
project that- most cultural heritage. materials are geared to the 
* older school-age Child who has the time perspective to learn about 
history, famous figures, and rather abstract concepts . Other 
tests combine knowledge questions with attitude guestions requiring 
the selection of words or faces along a "continuum of five or more 
steps -from positive to negative y^-lBI staff felt the younger ' 
children would not' be able to respond to this multiple choice 
anSWOF and that the results .would reflect their confusiqn leading 
to very poor "test reliability. * 

Cdntent Validity , . 

The -project teherefore elected to design its own test. Six 
^Spests of. culture were selected by the c educational director, in 
consultation with other staff, which he felt were aspects that 
would be meaningful "to * small children. 

* , , > 

Food was r one aspect chosen. Staff then^ideni^ilxed-^ood^-ltems 

which they felt were most typical of Mexico — arroz con polio, 
frijoles, enchilada, taco, cabrito, etc., and food most typical of 
the -United States — hamburger, hot dog, cherry pie, doughnuts, 
turfcey, etc. * ' . 

Clothing was another topic chosen. Staff nominated typically N 
items. Of clothing ftom Mexico — poncho, sombrero, huarach^s, etc/, 
ttncf from the y. S. — T-shirt, tennis shoes, blue jeans, etc.. « 

• The- topic representing the highest level of abstraction chosen 
was that of. national symbols — the 'f lags of both countries, and 
ttte Se*rof the U.S. with the eagle with the arrows and the olive 
branch, *ancl the Mexican eagle with the snake, in its talons. 

f 

The other topics chosen were holidays and celebrations of each 
culture (particularly those important'to young children), songs 
0n3 musical games (sung by 'young children or those used at holidays 
or celebrations. which, they would hear) ; 'and dances (that could be . 
danced by young children) . 

Host Qttiex tests .examined by the project before choosing to 
Writ* its ow n left but muoic a nd dance, whiclf^are commonly con- 
Slti|ere4 "rather important aspects of" af culture. We felt this was^ 
probtfbly because music and dance were difficult to portray in a 
paper and pencil test.. The project test, made a-tape to be played 
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on a cassette (singing by teachers, or 'music from records used 
for dancing) ^ith a small sample of each song or dance. Hearing 
this, the children were then ask'ed to choose between four 
pictures, the one that "went with 11 the music. 



All te^st items required a nonverbal response — choosing from 

four pictures in response to the cue given by the tester. Spanish' 

word cues were used for all items related to Mexican culture, 

English word cues for all items related to.U. S„ culture., 

* / 

Field Testing . «K • * , 

Field testing was._done of the original test and some pictures 
changed if the children could not readily recognize *the object. 
In other cases, a pair of pictures was tried out on children and 
the one most frequently chosen to represent something — e.g., the 
dance the "Hokey Pokey," was selected for «use in the test. 

Reliability Cat a 

The final , version of thfe test iyas given to 70 children In the 
Texas center during January 1976. The scores from this group of 
children were analyzed to determine the reliability of the instru--* 
ment. The Kuder Richardson 20 formula for reliability based on 
the pattern of answers to each test item, yielded a reliability 
ojf .90. For a project made instrument, this level of -reliability 
seemed acceptably high* « , ^ 

Norm Data , 

The IBI project has developed norm data from a norm group of 
over 2g0 children as of 1978. This norm data is reported in this** 
report Technical Appendix, Table 10. The norm group were project 
children of various ages, who were pretested as they enrolled in 
the IBI program. Approximately 75%. of the children were Spanish 
dominant, oyer 95% Mexican or Mexican African, and most come from 
families 1 ^doing seasonal or migrant farm work.- 

\ ■ I 

Administration Data — Time and Cost 

The test ^contains 44 test j/tems\ahd requires from 5 to 10 
minutes to administer. It must be given, individually; The test ' 
book contains 17 plates of four items each (68 picture choices) . 
The same plate of four pictures may be used for more than one test 
item, each plate containing one of more dummy choices as well as 
the pictures related to test questions./ Testers must also have 
the cassette tape f or^ the song and, dance questions.* The test , 
materials cost approximately $7.00, jblus the time of staff in 
assembling the test books, coloring in some items, and duplicating 
tapes. . % 
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